Jul 10 00:16:55 devstack cinder-volume[76850]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 00:16:55 devstack cinder-volume[76850]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 00:16:55 devstack cinder-volume[76850]: we strongly recommend against using it for new projects. Jul 10 00:16:55 devstack cinder-volume[76850]: If you are already using Eventlet, we recommend migrating to a different Jul 10 00:16:55 devstack cinder-volume[76850]: framework. For more detail see Jul 10 00:16:55 devstack cinder-volume[76850]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 00:16:55 devstack cinder-volume[76850]: import eventlet # noqa Jul 10 00:16:58 devstack cinder-volume[76850]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76850) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 00:16:58 devstack cinder-volume[76850]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76850) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 00:16:58 devstack cinder-volume[76850]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76850) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 00:16:59 devstack cinder-volume[76850]: INFO dbcounter [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Registered counter for database cinder Jul 10 00:16:59 devstack cinder-volume[76850]: DEBUG oslo_db.sqlalchemy.engines [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76850) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 00:16:59 devstack cinder-volume[76850]: DEBUG dbcounter [-] [76850] Writer thread running {{(pid=76850) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 00:16:59 devstack cinder-volume[76850]: INFO cinder.rpc [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 00:16:59 devstack cinder-volume[76850]: INFO cinder.rpc [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 00:16:59 devstack cinder-volume[76850]: DEBUG oslo_db.sqlalchemy.engines [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76850) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 00:16:59 devstack cinder-volume[76850]: INFO cinder.volume.manager [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Determined volume DB was empty at startup. Jul 10 00:16:59 devstack cinder-volume[76850]: DEBUG cinder.volume.manager [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76850) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 00:16:59 devstack cinder-volume[76850]: INFO cinder.volume.manager [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 10 00:16:59 devstack cinder-volume[76850]: WARNING stevedore.named [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 00:16:59 devstack cinder-volume[76850]: WARNING castellan.key_manager [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 00:16:59 devstack cinder-volume[76850]: WARNING cinder.keymgr.conf_key_mgr [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 00:16:59 devstack cinder-volume[76850]: DEBUG cinder.volume.drivers.lvm [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76850) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 10 00:16:59 devstack cinder-volume[76850]: DEBUG oslo_concurrency.processutils [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76850) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_concurrency.processutils [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] CMD "cinder-rtstool verify" returned: 0 in 0.389s {{(pid=76850) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_db.sqlalchemy.engines [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76850) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 00:17:00 devstack cinder-volume[76850]: INFO cinder.rpc [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 10 00:17:00 devstack cinder-volume[76850]: INFO cinder.rpc [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 10 00:17:00 devstack cinder-volume[76850]: WARNING stevedore.named [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 00:17:00 devstack cinder-volume[76850]: WARNING castellan.key_manager [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 00:17:00 devstack cinder-volume[76850]: INFO cinder.volume.manager [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_db.sqlalchemy.engines [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76850) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 00:17:00 devstack cinder-volume[76850]: INFO oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Starting 1 workers Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Started child 77026 {{(pid=76850) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 00:17:00 devstack cinder-volume[77026]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Full set of CONF: {{(pid=76850) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] ******************************************************************************** {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Configuration options gathered from: {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] ================================================================================ {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] allow_availability_zone_fallback = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] allow_compression_on_image_upload = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] allowed_direct_url_schemes = [] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] api_rate_limit = True {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] auth_strategy = keystone {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] az_cache_duration = 3600 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_availability_zone = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_host = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_name = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_stats_polling_interval = 60 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backup_api_class = cinder.backup.api.API {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backup_name_template = backup-%s {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backup_use_same_host = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backup_use_temp_snapshot = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] chap_password = **** {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] chap_username = {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cinder_internal_tenant_project_id = 8faef378b3554e049342c051a70e50cd {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cinder_internal_tenant_user_id = 2e83a4399c47451d9282aaf4a5ff0db9 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cloned_volume_same_az = True {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cluster = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] compression_format = gzip {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] compute_api_class = cinder.compute.nova.API {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] config_dir = [] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] config_source = [] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] control_exchange = openstack {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] debug = True {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] default_availability_zone = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] default_group_type = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] default_volume_type = lvmdriver-1 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] disk_geometry = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] driver_client_cert = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[77026]: INFO cinder.volume.manager [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 10 00:17:00 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] driver_client_cert_key = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] driver_data_namespace = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] driver_ssl_cert_path = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] driver_ssl_cert_verify = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] driver_use_ssl = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] enable_force_upload = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] enable_new_services = True {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] enable_unsupported_driver = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] enabled_backends = ['lvmdriver-1'] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] enforce_multipath_for_image_xfer = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] filter_function = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] glance_api_insecure = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] glance_api_servers = ['http://192.168.122.142/image'] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] glance_api_ssl_compression = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] glance_ca_certificates_file = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] glance_catalog_info = image:glance:publicURL {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] glance_certfile = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] glance_keyfile = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] glance_num_retries = 3 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] glance_request_timeout = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] goodness_function = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] graceful_shutdown_timeout = 5 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] group_api_class = cinder.group.api.API {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] host = devstack {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] image_compress_on_upload = True {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] image_conversion_address_space_limit = 1 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] image_conversion_cpu_limit = 60 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] image_conversion_disable = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] image_upload_use_cinder_backend = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] image_upload_use_internal_tenant = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] image_volume_cache_enabled = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] image_volume_cache_max_count = 0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] image_volume_cache_max_size_gb = 0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] init_host_max_objects_retrieval = 0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] instance_format = [instance: %(uuid)s] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] iscsi_target_flags = {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] iscsi_write_cache = on {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack sudo[77030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] iser_helper = tgtadm {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] iser_ip_address = 192.168.122.142 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] iser_port = 3260 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] log_color = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] log_config_append = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack sudo[77030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] log_dir = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] log_file = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] log_options = True {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] log_rotate_interval = 1 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] log_rotate_interval_type = days {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] log_rotation_type = none {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:00 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] max_age = 0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] max_logfile_count = 30 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] max_logfile_size_mb = 200 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] max_over_subscription_ratio = 20.0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] message_reap_interval = 86400 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] message_ttl = 2592000 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] migration_create_volume_timeout_secs = 300 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] monkey_patch = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] monkey_patch_modules = [] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] my_ip = 192.168.122.142 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] no_snapshot_gb_quota = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] num_iser_scan_tries = 3 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] num_shell_tries = 3 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] num_volume_device_scan_tries = 3 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] nvmeof_conn_info_version = 1 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] nvmet_ns_id = 10 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] nvmet_port_id = 1 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] osapi_max_limit = 1000 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] osapi_volume_ext_list = [] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] osapi_volume_listen = 0.0.0.0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] osapi_volume_listen_port = 8776 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] osapi_volume_use_ssl = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] osapi_volume_workers = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] per_volume_size_limit = -1 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] periodic_fuzzy_delay = 60 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] periodic_interval = 60 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] project_id_regex = [0-9a-f\-]+ {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] public_endpoint = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] publish_errors = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] quota_backup_gigabytes = 1000 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] quota_backups = 10 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] quota_gigabytes = 1000 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] quota_groups = 10 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] quota_snapshots = 10 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] quota_volumes = 10 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] rate_limit_burst = 0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] rate_limit_except_level = CRITICAL {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] rate_limit_interval = 0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] reinit_driver_count = 3 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] replication_device = **** {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] report_discard_supported = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] report_interval = 120 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] reservation_clean_interval = 86400 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] reservation_expire = 86400 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] reserved_image_namespaces = [] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] reserved_percentage = 0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] rpc_response_timeout = 120 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] run_external_periodic_tasks = True {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] scst_target_driver = iscsi {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] scst_target_iqn_name = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] service_down_time = 720 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] shell_completion = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] snapshot_name_template = snapshot-%s {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] snapshot_same_host = True {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] split_loggers = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] state_path = /opt/stack/data/cinder {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] storage_availability_zone = nova {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] storage_protocol = iSCSI {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] syslog_log_facility = LOG_USER {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] target_helper = lioadm {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] target_ip_address = 192.168.122.142 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] target_port = 3260 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] target_protocol = iscsi {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] target_secondary_ip_addresses = [] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] trace_flags = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] transfer_api_class = cinder.transfer.api.API {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] transport_url = **** {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] until_refresh = 0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] use_chap_auth = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] use_default_quota_class = True {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] use_journal = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] use_json = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] use_multipath_for_image_xfer = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] use_stderr = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] use_syslog = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] verify_glance_signatures = enabled {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] volume_api_class = cinder.volume.api.API {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] volume_backend_name = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] volume_clear = zero {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] volume_clear_ionice = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] volume_clear_size = 0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] volume_copy_bps_limit = 0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] volume_dd_blocksize = 1M {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] volume_name_template = volume-%s {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] volume_service_inithost_offload = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] volume_usage_audit_period = month {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] zoning_mode = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_concurrency.disable_process_locking = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.auth_section = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.auth_type = password {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.auth_version = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.cache = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.certfile = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.delay_auth_decision = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.http_connect_timeout = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.include_service_catalog = True {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.insecure = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.interface = public {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.keyfile = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.memcache_password = {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:00 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:00 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.memcache_username = {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.region_name = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.service_token_roles_required = True {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.service_type = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.token_cache_time = 300 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.142/identity {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.backend = dogpile.cache.null {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.backend_argument = **** {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.backend_expiration_time = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.config_prefix = cache.oslo {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.debug_cache_backend = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.enable_retry_client = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.enable_socket_keepalive = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.enabled = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.expiration_time = 600 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.hashclient_retry_attempts = 2 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.memcache_dead_retry = 300 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.memcache_pool_maxsize = 10 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.memcache_sasl_enabled = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.password = **** {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.proxies = [] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.redis_db = 0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.redis_sentinel_service_name = mymaster {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.redis_server = localhost:6379 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.retry_attempts = 2 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.retry_delay = 0.0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.socket_keepalive_count = 1 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.socket_keepalive_idle = 1 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.socket_keepalive_interval = 1 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.socket_timeout = 1.0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.tls_allowed_ciphers = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.tls_cafile = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.tls_certfile = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.tls_enabled = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.tls_keyfile = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cache.username = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] coordination.backend_url = **** {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] database.asyncio_connection = **** {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] database.asyncio_slave_connection = **** {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] database.backend = sqlalchemy {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] database.connection = **** {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] database.connection_debug = 0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] database.connection_parameters = {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] database.connection_recycle_time = 3600 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] database.connection_trace = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] database.db_inc_retry_interval = True {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] database.db_max_retries = 20 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] database.db_max_retry_interval = 10 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] database.db_retry_interval = 1 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] database.max_overflow = 50 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] database.max_pool_size = 5 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] database.max_retries = 10 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] database.mysql_wsrep_sync_wait = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] database.pool_timeout = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] database.retry_interval = 10 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] database.slave_connection = **** {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] database.sqlite_synchronous = True {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] database.synchronous_reader = True {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] database.use_db_reconnect = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] profiler.connection_string = messaging:// {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] profiler.enabled = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] profiler.es_doc_type = notification {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] profiler.es_scroll_size = 10000 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] profiler.es_scroll_time = 2m {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] profiler.filter_error_trace = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] profiler.hmac_keys = **** {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] profiler.sentinel_service_name = mymaster {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] profiler.socket_timeout = 0.1 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] profiler.trace_requests = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] profiler.trace_sqlalchemy = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] profiler_jaeger.process_tags = {} {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] profiler_jaeger.service_name_prefix = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] profiler_otlp.service_name_prefix = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_policy.enforce_new_defaults = True {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_policy.enforce_scope = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_policy.policy_default_rule = default {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_policy.policy_file = policy.yaml {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_policy.remote_timeout = 60.0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] privsep_osbrick.group = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] privsep_osbrick.helper_command = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] privsep_osbrick.user = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cinder_sys_admin.group = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cinder_sys_admin.helper_command = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] cinder_sys_admin.user = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] service_user.auth_section = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] service_user.auth_type = password {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] service_user.cafile = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] service_user.certfile = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] service_user.collect_timing = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] service_user.insecure = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] service_user.keyfile = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] service_user.send_service_user_token = True {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] service_user.split_loggers = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] service_user.timeout = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] glance.auth_section = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] glance.auth_type = password {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] glance.certfile = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] glance.collect_timing = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] glance.insecure = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] glance.keyfile = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] glance.region_name = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] glance.split_loggers = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] glance.timeout = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.backend_availability_zone = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.chap_password = **** {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.chap_username = {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.disk_geometry = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.driver_client_cert = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.driver_client_cert_key = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.driver_data_namespace = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.driver_use_ssl = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.enable_unsupported_driver = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.extra_capabilities = {} {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.filter_function = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.goodness_function = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.iscsi_target_flags = {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.iscsi_write_cache = on {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.iser_helper = tgtadm {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.iser_ip_address = 192.168.122.142 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.iser_port = 3260 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.lvm_mirrors = 0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.lvm_share_target = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.lvm_type = auto {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.num_shell_tries = 3 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.nvmet_port_id = 1 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.replication_device = **** {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.report_discard_supported = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.reserved_percentage = 0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.scst_target_driver = iscsi {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.scst_target_iqn_name = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.storage_protocol = iSCSI {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.target_helper = tgtadm {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.target_ip_address = 192.168.122.142 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.target_port = 3260 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.target_protocol = iscsi {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.trace_flags = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.unique_fqdn_network = True {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.use_chap_auth = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.volume_backend_name = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.volume_clear = zero {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.volume_clear_ionice = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.volume_clear_size = 0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.volume_group = cinder-volumes {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_reports.file_event_handler = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_reports.log_dir = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.backend_availability_zone = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.backend_host = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.chap_password = **** {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.chap_username = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.chiscsi_conf = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.disk_geometry = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.driver_client_cert = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.driver_data_namespace = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.driver_use_ssl = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.extra_capabilities = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.filter_function = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.goodness_function = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.iser_helper = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.iser_ip_address = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.iser_port = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.iser_target_prefix = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.lvm_conf_file = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.lvm_mirrors = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.lvm_share_target = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.lvm_type = auto {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.num_shell_tries = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.nvmet_port_id = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.replication_device = **** {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.report_discard_supported = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.reserved_percentage = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.scst_target_driver = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.storage_protocol = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.target_helper = lioadm {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.target_ip_address = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.target_port = 3260 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.target_protocol = iscsi {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.trace_flags = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.use_chap_auth = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.volume_clear = zero {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.volume_clear_size = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] lvmdriver-1.volumes_dir = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.ssl = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.ssl_version = {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_notifications.driver = [] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_notifications.retry = -1 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] oslo_messaging_notifications.transport_url = **** {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] key_manager.fixed_key = **** {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] barbican.barbican_api_version = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] barbican.barbican_endpoint = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] barbican.barbican_endpoint_type = public {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] barbican.barbican_region_name = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] barbican.cafile = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] barbican.certfile = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] barbican.collect_timing = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] barbican.insecure = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] barbican.keyfile = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] barbican.number_of_retries = 60 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] barbican.retry_delay = 1 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] barbican.send_service_user_token = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] barbican.split_loggers = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] barbican.timeout = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] barbican.verify_ssl = True {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] barbican.verify_ssl_path = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] barbican_service_user.auth_section = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] barbican_service_user.auth_type = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] barbican_service_user.cafile = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] barbican_service_user.certfile = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] barbican_service_user.collect_timing = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] barbican_service_user.insecure = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] barbican_service_user.keyfile = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] barbican_service_user.split_loggers = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] barbican_service_user.timeout = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] vault.approle_role_id = **** {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] vault.approle_secret_id = **** {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] vault.kv_mountpoint = secret {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] vault.kv_path = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] vault.kv_version = 2 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] vault.namespace = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] vault.root_token_id = **** {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] vault.ssl_ca_crt_file = None {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] vault.timeout = 60.0 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] vault.use_ssl = False {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:17:01 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] ******************************************************************************** {{(pid=76850) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 00:17:01 devstack sudo[77030]: pam_unix(sudo:session): session closed for user root Jul 10 00:17:01 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.768s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:01 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:01 devstack sudo[77307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 00:17:01 devstack sudo[77307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:17:02 devstack sudo[77307]: pam_unix(sudo:session): session closed for user root Jul 10 00:17:02 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.690s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:02 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:17:02 devstack cinder-volume[77026]: INFO cinder.brick.local_dev.lvm [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 10 00:17:02 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:02 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:02 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:02 devstack sudo[77517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 00:17:02 devstack sudo[77517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:17:02 devstack sudo[77517]: pam_unix(sudo:session): session closed for user root Jul 10 00:17:02 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.745s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:02 devstack cinder-volume[77026]: DEBUG cinder.brick.local_dev.lvm [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77026) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 10 00:17:02 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:02 devstack sudo[77677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 00:17:02 devstack sudo[77677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:17:03 devstack sudo[77677]: pam_unix(sudo:session): session closed for user root Jul 10 00:17:03 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.033s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:03 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:03 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:03 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:03 devstack sudo[77805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 00:17:03 devstack sudo[77805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:17:04 devstack sudo[77805]: pam_unix(sudo:session): session closed for user root Jul 10 00:17:04 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.688s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:04 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:04 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:04 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:04 devstack sudo[77811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 10 00:17:04 devstack sudo[77811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:17:05 devstack sudo[77811]: pam_unix(sudo:session): session closed for user root Jul 10 00:17:05 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.646s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:05 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:05 devstack sudo[77815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 00:17:05 devstack sudo[77815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:17:05 devstack sudo[77815]: pam_unix(sudo:session): session closed for user root Jul 10 00:17:05 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.697s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:05 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:05 devstack sudo[77828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 00:17:05 devstack sudo[77828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:17:06 devstack sudo[77828]: pam_unix(sudo:session): session closed for user root Jul 10 00:17:06 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.686s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:06 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:06 devstack sudo[77831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:17:06 devstack sudo[77831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:17:07 devstack sudo[77831]: pam_unix(sudo:session): session closed for user root Jul 10 00:17:07 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.704s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:07 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:07 devstack sudo[77837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 00:17:07 devstack sudo[77837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:17:08 devstack sudo[77837]: pam_unix(sudo:session): session closed for user root Jul 10 00:17:08 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.963s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:08 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:08 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:08 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:08 devstack sudo[77842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 00:17:08 devstack sudo[77842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:17:09 devstack sudo[77842]: pam_unix(sudo:session): session closed for user root Jul 10 00:17:09 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.893s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:09 devstack cinder-volume[77026]: INFO cinder.volume.drivers.lvm [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 10 00:17:09 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:09 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:09 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:09 devstack sudo[77918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 00:17:09 devstack sudo[77918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:17:10 devstack sudo[77918]: pam_unix(sudo:session): session closed for user root Jul 10 00:17:10 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.720s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:10 devstack cinder-volume[77026]: DEBUG cinder.volume.drivers.lvm [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Updating volume stats {{(pid=77026) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 00:17:10 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:10 devstack sudo[77972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 00:17:10 devstack sudo[77972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:17:10 devstack cinder-volume[76850]: DEBUG dbcounter [-] [76850] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76850) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:17:10 devstack sudo[77972]: pam_unix(sudo:session): session closed for user root Jul 10 00:17:10 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.695s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:10 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:10 devstack sudo[78114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:17:10 devstack sudo[78114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:17:11 devstack sudo[78114]: pam_unix(sudo:session): session closed for user root Jul 10 00:17:11 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:11 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:11 devstack sudo[78117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 00:17:11 devstack sudo[78117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:17:12 devstack sudo[78117]: pam_unix(sudo:session): session closed for user root Jul 10 00:17:12 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.670s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:12 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:12 devstack sudo[78120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:17:12 devstack sudo[78120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:17:12 devstack sudo[78120]: pam_unix(sudo:session): session closed for user root Jul 10 00:17:12 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:12 devstack cinder-volume[77026]: INFO cinder.volume.driver [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Driver hasn't implemented _init_vendor_properties() Jul 10 00:17:12 devstack cinder-volume[77026]: DEBUG cinder.volume.driver [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77026) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 00:17:12 devstack cinder-volume[77026]: DEBUG oslo_db.sqlalchemy.engines [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77026) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 00:17:12 devstack cinder-volume[77026]: DEBUG dbcounter [-] [77026] Writer thread running {{(pid=77026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 00:17:12 devstack cinder-volume[77026]: DEBUG cinder.db.api [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Building query based on filter {{(pid=77026) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 00:17:12 devstack cinder-volume[77026]: DEBUG cinder.image.image_utils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77026) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 00:17:12 devstack cinder-volume[77026]: INFO cinder.keymgr.migration [None req-7a10811b-0c13-4c69-9e16-40a4213ea9e7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 00:17:12 devstack cinder-volume[77026]: DEBUG cinder.volume.drivers.lvm [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Updating volume stats {{(pid=77026) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 00:17:12 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:12 devstack sudo[78124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 00:17:12 devstack sudo[78124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:17:13 devstack sudo[78124]: pam_unix(sudo:session): session closed for user root Jul 10 00:17:13 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:13 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:13 devstack sudo[78131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:17:13 devstack sudo[78131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:17:14 devstack sudo[78131]: pam_unix(sudo:session): session closed for user root Jul 10 00:17:14 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:14 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:14 devstack sudo[78136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 00:17:14 devstack sudo[78136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:17:14 devstack sudo[78136]: pam_unix(sudo:session): session closed for user root Jul 10 00:17:14 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.666s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:14 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:14 devstack sudo[78140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:17:14 devstack sudo[78140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:17:15 devstack sudo[78140]: pam_unix(sudo:session): session closed for user root Jul 10 00:17:15 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:15 devstack cinder-volume[77026]: DEBUG cinder.manager [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Notifying Schedulers of capabilities ... {{(pid=77026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:17:15 devstack cinder-volume[77026]: INFO cinder.volume.manager [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Driver initialization completed successfully. Jul 10 00:17:15 devstack cinder-volume[77026]: INFO cinder.manager [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Initiating service 2 cleanup Jul 10 00:17:15 devstack cinder-volume[77026]: INFO cinder.manager [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Service 2 cleanup completed. Jul 10 00:17:15 devstack cinder-volume[77026]: DEBUG cinder.service [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Creating RPC server for service cinder-volume {{(pid=77026) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 00:17:15 devstack cinder-volume[77026]: DEBUG cinder.service [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77026) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 00:17:15 devstack cinder-volume[77026]: INFO cinder.volume.manager [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 10 00:17:15 devstack cinder-volume[77026]: DEBUG cinder.volume.drivers.lvm [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Updating volume stats {{(pid=77026) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 00:17:15 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:15 devstack sudo[78144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 00:17:15 devstack sudo[78144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:17:16 devstack sudo[78144]: pam_unix(sudo:session): session closed for user root Jul 10 00:17:16 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:16 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:16 devstack sudo[78147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:17:16 devstack sudo[78147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:17:16 devstack sudo[78147]: pam_unix(sudo:session): session closed for user root Jul 10 00:17:16 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:16 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:16 devstack sudo[78207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 00:17:16 devstack sudo[78207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:17:17 devstack sudo[78207]: pam_unix(sudo:session): session closed for user root Jul 10 00:17:17 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.647s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:17 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:17:17 devstack sudo[78210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:17:17 devstack sudo[78210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:17:18 devstack sudo[78210]: pam_unix(sudo:session): session closed for user root Jul 10 00:17:18 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:17:18 devstack cinder-volume[77026]: INFO cinder.volume.manager [None req-dce773b8-2b25-4a48-aad0-2bd3fa575bd3 None None] Driver post RPC initialization completed successfully. Jul 10 00:17:28 devstack cinder-volume[77026]: DEBUG dbcounter [-] [77026] Writing DB stats cinder:SELECT=4 {{(pid=77026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:17:28 devstack cinder-volume[77026]: DEBUG dbcounter [-] [77026] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=77026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:17:36 devstack cinder-volume[77026]: DEBUG oslo_service.periodic_task [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Running periodic task VolumeManager._thread_info {{(pid=77026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:17:36 devstack cinder-volume[77026]: DEBUG cinder.volume.manager [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] thread count: 6 {{(pid=77026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:17:36 devstack cinder-volume[77026]: DEBUG cinder.volume.manager [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] thread info: [<_MainThread(MainThread, started 135845184675968)>, , , , , ] {{(pid=77026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:18:36 devstack cinder-volume[77026]: DEBUG oslo_service.periodic_task [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:18:36 devstack cinder-volume[77026]: DEBUG cinder.volume.drivers.lvm [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Updating volume stats {{(pid=77026) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 00:18:36 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:18:36 devstack sudo[80562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 00:18:36 devstack sudo[80562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:18:36 devstack sudo[80562]: pam_unix(sudo:session): session closed for user root Jul 10 00:18:36 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:18:36 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:18:36 devstack sudo[80565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:18:36 devstack sudo[80565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:18:37 devstack sudo[80565]: pam_unix(sudo:session): session closed for user root Jul 10 00:18:37 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:18:37 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:18:37 devstack sudo[80569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 00:18:37 devstack sudo[80569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:18:38 devstack sudo[80569]: pam_unix(sudo:session): session closed for user root Jul 10 00:18:38 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.602s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:18:38 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:18:38 devstack sudo[80572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:18:38 devstack sudo[80572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:18:38 devstack sudo[80572]: pam_unix(sudo:session): session closed for user root Jul 10 00:18:38 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.607s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:18:38 devstack cinder-volume[77026]: DEBUG cinder.manager [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Notifying Schedulers of capabilities ... {{(pid=77026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:18:38 devstack cinder-volume[77026]: DEBUG oslo_service.periodic_task [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Running periodic task VolumeManager._thread_info {{(pid=77026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:18:38 devstack cinder-volume[77026]: DEBUG cinder.volume.manager [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] thread count: 6 {{(pid=77026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:18:38 devstack cinder-volume[77026]: DEBUG cinder.volume.manager [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] thread info: [<_MainThread(MainThread, started 135845184675968)>, , , , , ] {{(pid=77026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:19:28 devstack cinder-volume[77026]: DEBUG dbcounter [-] [77026] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:19:36 devstack cinder-volume[77026]: DEBUG oslo_service.periodic_task [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:19:36 devstack cinder-volume[77026]: DEBUG cinder.volume.drivers.lvm [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Updating volume stats {{(pid=77026) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 00:19:36 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:19:36 devstack sudo[83805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 00:19:36 devstack sudo[83805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:19:36 devstack sudo[83805]: pam_unix(sudo:session): session closed for user root Jul 10 00:19:36 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:19:36 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:19:36 devstack sudo[83831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:19:36 devstack sudo[83831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:19:37 devstack sudo[83831]: pam_unix(sudo:session): session closed for user root Jul 10 00:19:37 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:19:37 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:19:37 devstack sudo[83839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 00:19:37 devstack sudo[83839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:19:38 devstack sudo[83839]: pam_unix(sudo:session): session closed for user root Jul 10 00:19:38 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.621s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:19:38 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:19:38 devstack sudo[84186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:19:38 devstack sudo[84186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:19:38 devstack sudo[84186]: pam_unix(sudo:session): session closed for user root Jul 10 00:19:38 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:19:38 devstack cinder-volume[77026]: DEBUG cinder.manager [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Notifying Schedulers of capabilities ... {{(pid=77026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:19:38 devstack cinder-volume[77026]: DEBUG oslo_service.periodic_task [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Running periodic task VolumeManager._thread_info {{(pid=77026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:19:38 devstack cinder-volume[77026]: DEBUG cinder.volume.manager [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] thread count: 6 {{(pid=77026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:19:38 devstack cinder-volume[77026]: DEBUG cinder.volume.manager [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] thread info: [<_MainThread(MainThread, started 135845184675968)>, , , , , ] {{(pid=77026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:20:36 devstack cinder-volume[77026]: DEBUG oslo_service.periodic_task [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:20:36 devstack cinder-volume[77026]: DEBUG cinder.volume.drivers.lvm [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Updating volume stats {{(pid=77026) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 00:20:36 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:20:36 devstack sudo[85801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 00:20:36 devstack sudo[85801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:20:36 devstack sudo[85801]: pam_unix(sudo:session): session closed for user root Jul 10 00:20:36 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:20:36 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:20:36 devstack sudo[85827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:20:36 devstack sudo[85827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:20:37 devstack sudo[85827]: pam_unix(sudo:session): session closed for user root Jul 10 00:20:37 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:20:37 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:20:37 devstack sudo[85852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 00:20:37 devstack sudo[85852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:20:38 devstack sudo[85852]: pam_unix(sudo:session): session closed for user root Jul 10 00:20:38 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.606s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:20:38 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:20:38 devstack sudo[85871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:20:38 devstack sudo[85871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:20:38 devstack sudo[85871]: pam_unix(sudo:session): session closed for user root Jul 10 00:20:38 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:20:38 devstack cinder-volume[77026]: DEBUG cinder.manager [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Notifying Schedulers of capabilities ... {{(pid=77026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:20:38 devstack cinder-volume[77026]: DEBUG oslo_service.periodic_task [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Running periodic task VolumeManager._thread_info {{(pid=77026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:20:38 devstack cinder-volume[77026]: DEBUG cinder.volume.manager [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] thread count: 6 {{(pid=77026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:20:38 devstack cinder-volume[77026]: DEBUG cinder.volume.manager [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] thread info: [<_MainThread(MainThread, started 135845184675968)>, , , , , ] {{(pid=77026) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:21:28 devstack cinder-volume[77026]: DEBUG dbcounter [-] [77026] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77026) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:21:35 devstack cinder-volume[76850]: INFO oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Caught SIGTERM, stopping children Jul 10 00:21:35 devstack cinder-volume[76850]: DEBUG oslo_concurrency.lockutils [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Acquiring lock "singleton_lock" {{(pid=76850) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 00:21:35 devstack cinder-volume[76850]: DEBUG oslo_concurrency.lockutils [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Acquired lock "singleton_lock" {{(pid=76850) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 00:21:35 devstack cinder-volume[76850]: DEBUG oslo_concurrency.lockutils [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Releasing lock "singleton_lock" {{(pid=76850) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 00:21:35 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Stop services. {{(pid=76850) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 10 00:21:35 devstack cinder-volume[76850]: DEBUG oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Killing children. {{(pid=76850) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 10 00:21:35 devstack cinder-volume[76850]: INFO oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Waiting on 1 children to exit Jul 10 00:21:36 devstack cinder-volume[77026]: DEBUG oslo_service.periodic_task [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77026) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:21:36 devstack cinder-volume[77026]: DEBUG cinder.volume.drivers.lvm [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Updating volume stats {{(pid=77026) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 00:21:36 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:21:36 devstack sudo[87141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 00:21:36 devstack sudo[87141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:21:36 devstack sudo[87141]: pam_unix(sudo:session): session closed for user root Jul 10 00:21:36 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:21:36 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:21:36 devstack sudo[87144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:21:36 devstack sudo[87144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:21:37 devstack sudo[87144]: pam_unix(sudo:session): session closed for user root Jul 10 00:21:37 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.608s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:21:37 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:21:37 devstack sudo[87148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 00:21:37 devstack sudo[87148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:21:38 devstack sudo[87148]: pam_unix(sudo:session): session closed for user root Jul 10 00:21:38 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.634s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:21:38 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:21:38 devstack sudo[87151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 00:21:38 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:21:38 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root Jul 10 00:21:38 devstack cinder-volume[77026]: DEBUG oslo_concurrency.processutils [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=77026) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:21:38 devstack cinder-volume[77026]: DEBUG cinder.manager [None req-824bd8e2-9c6c-4b70-9705-cfae82624c53 None None] Notifying Schedulers of capabilities ... {{(pid=77026) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:21:40 devstack cinder-volume[77026]: DEBUG oslo_concurrency.lockutils [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Acquiring lock "singleton_lock" {{(pid=77026) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 00:21:40 devstack cinder-volume[77026]: DEBUG oslo_concurrency.lockutils [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Acquired lock "singleton_lock" {{(pid=77026) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 00:21:40 devstack cinder-volume[77026]: DEBUG oslo_concurrency.lockutils [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Releasing lock "singleton_lock" {{(pid=77026) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 00:21:40 devstack cinder-volume[77026]: WARNING amqp [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 00:21:40 devstack cinder-volume[77026]: WARNING amqp [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 00:21:40 devstack cinder-volume[76850]: INFO oslo_service.backend._eventlet.service [None req-761e9053-d1b7-4e59-b039-ae963066257f None None] Child 77026 exited with status 0 Jul 10 00:21:40 devstack cinder-volume[87157]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 00:21:40 devstack cinder-volume[87157]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 00:21:40 devstack cinder-volume[87157]: we strongly recommend against using it for new projects. Jul 10 00:21:40 devstack cinder-volume[87157]: If you are already using Eventlet, we recommend migrating to a different Jul 10 00:21:40 devstack cinder-volume[87157]: framework. For more detail see Jul 10 00:21:40 devstack cinder-volume[87157]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 00:21:40 devstack cinder-volume[87157]: import eventlet # noqa Jul 10 00:21:42 devstack cinder-volume[87157]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87157) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 00:21:42 devstack cinder-volume[87157]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87157) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 00:21:42 devstack cinder-volume[87157]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87157) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 00:21:43 devstack cinder-volume[87157]: INFO dbcounter [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] Registered counter for database cinder Jul 10 00:21:43 devstack cinder-volume[87157]: DEBUG oslo_db.sqlalchemy.engines [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87157) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG dbcounter [-] [87157] Writer thread running {{(pid=87157) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 00:21:44 devstack cinder-volume[87157]: INFO cinder.rpc [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 00:21:44 devstack cinder-volume[87157]: INFO cinder.rpc [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_db.sqlalchemy.engines [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87157) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 00:21:44 devstack cinder-volume[87157]: INFO cinder.volume.manager [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] Determined volume DB was empty at startup. Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG cinder.volume.manager [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87157) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 00:21:44 devstack cinder-volume[87157]: INFO cinder.volume.manager [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 10 00:21:44 devstack cinder-volume[87157]: WARNING stevedore.named [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 00:21:44 devstack cinder-volume[87157]: WARNING castellan.key_manager [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 00:21:44 devstack cinder-volume[87157]: WARNING cinder.keymgr.conf_key_mgr [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 00:21:44 devstack cinder-volume[87157]: INFO cinder.volume.manager [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_db.sqlalchemy.engines [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87157) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 00:21:44 devstack cinder-volume[87157]: INFO oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] Starting 1 workers Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] Started child 87375 {{(pid=87157) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] Full set of CONF: {{(pid=87157) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] ******************************************************************************** {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] Configuration options gathered from: {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] ================================================================================ {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] allow_availability_zone_fallback = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] allow_compression_on_image_upload = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] allowed_direct_url_schemes = [] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] api_rate_limit = True {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] auth_strategy = keystone {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87375]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_availability_zone = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_host = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_name = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_stats_polling_interval = 60 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backup_api_class = cinder.backup.api.API {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backup_name_template = backup-%s {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backup_use_same_host = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backup_use_temp_snapshot = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] chap_password = **** {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] chap_username = {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cinder_internal_tenant_project_id = 8faef378b3554e049342c051a70e50cd {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cinder_internal_tenant_user_id = 2e83a4399c47451d9282aaf4a5ff0db9 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cluster = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] compression_format = gzip {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] compute_api_class = cinder.compute.nova.API {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] config_dir = [] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] config_source = [] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] control_exchange = openstack {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] debug = True {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] default_availability_zone = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] default_group_type = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] default_volume_type = QuobyteHD {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] disk_geometry = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] driver_client_cert = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] driver_client_cert_key = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] driver_data_namespace = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] driver_ssl_cert_path = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] driver_ssl_cert_verify = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] driver_use_ssl = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] enable_new_services = True {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] enable_unsupported_driver = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] enabled_backends = ['QuobyteHD'] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] enforce_multipath_for_image_xfer = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] filter_function = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] glance_api_insecure = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] glance_api_servers = ['http://192.168.122.142/image'] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] glance_api_ssl_compression = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] glance_ca_certificates_file = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] glance_catalog_info = image:glance:publicURL {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] glance_certfile = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] glance_keyfile = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] glance_num_retries = 3 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] glance_request_timeout = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] goodness_function = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] graceful_shutdown_timeout = 5 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] group_api_class = cinder.group.api.API {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] host = devstack {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] image_compress_on_upload = True {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] image_conversion_address_space_limit = 1 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] image_conversion_cpu_limit = 60 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] image_conversion_disable = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] image_upload_use_cinder_backend = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] image_upload_use_internal_tenant = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] image_volume_cache_enabled = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] image_volume_cache_max_count = 0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] image_volume_cache_max_size_gb = 0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] init_host_max_objects_retrieval = 0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] instance_format = [instance: %(uuid)s] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] iscsi_target_flags = {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] iscsi_write_cache = on {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] iser_helper = tgtadm {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] iser_ip_address = 192.168.122.142 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] iser_port = 3260 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] log_color = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] log_config_append = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] log_dir = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] log_file = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] log_options = True {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] log_rotate_interval = 1 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] log_rotate_interval_type = days {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] log_rotation_type = none {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] max_age = 0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] max_logfile_count = 30 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] max_logfile_size_mb = 200 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] max_over_subscription_ratio = 20.0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] message_reap_interval = 86400 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] message_ttl = 2592000 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] migration_create_volume_timeout_secs = 300 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] monkey_patch = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] monkey_patch_modules = [] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] my_ip = 192.168.122.142 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] no_snapshot_gb_quota = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] num_iser_scan_tries = 3 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] num_shell_tries = 3 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] num_volume_device_scan_tries = 3 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] nvmeof_conn_info_version = 1 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] nvmet_ns_id = 10 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] nvmet_port_id = 1 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] osapi_max_limit = 1000 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] osapi_volume_ext_list = [] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] osapi_volume_listen = 0.0.0.0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] osapi_volume_listen_port = 8776 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] osapi_volume_use_ssl = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] osapi_volume_workers = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] per_volume_size_limit = -1 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] periodic_fuzzy_delay = 60 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] periodic_interval = 60 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] project_id_regex = [0-9a-f\-]+ {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] public_endpoint = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] publish_errors = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] quota_backup_gigabytes = 1000 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] quota_backups = 10 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87375]: INFO cinder.volume.manager [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Starting volume driver QuobyteDriver (1.1.14) Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] quota_gigabytes = 1000 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] quota_groups = 10 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] quota_snapshots = 10 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87375]: DEBUG cinder.volume.drivers.remotefs [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87375) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] quota_volumes = 10 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] rate_limit_burst = 0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] rate_limit_except_level = CRITICAL {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] rate_limit_interval = 0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] reinit_driver_count = 3 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] replication_device = **** {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] report_discard_supported = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] report_interval = 120 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] reservation_clean_interval = 86400 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] reservation_expire = 86400 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] reserved_image_namespaces = [] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] reserved_percentage = 0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] rpc_response_timeout = 120 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] run_external_periodic_tasks = True {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] scst_target_driver = iscsi {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] scst_target_iqn_name = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] service_down_time = 720 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] shell_completion = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] snapshot_name_template = snapshot-%s {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] split_loggers = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] state_path = /opt/stack/data/cinder {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] storage_availability_zone = nova {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] storage_protocol = iSCSI {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] syslog_log_facility = LOG_USER {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] target_helper = lioadm {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] target_ip_address = 192.168.122.142 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] target_port = 3260 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] target_protocol = iscsi {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] target_secondary_ip_addresses = [] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] trace_flags = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] transfer_api_class = cinder.transfer.api.API {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] transport_url = **** {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] until_refresh = 0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] use_chap_auth = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] use_default_quota_class = True {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] use_journal = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] use_json = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] use_multipath_for_image_xfer = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] use_stderr = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] use_syslog = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] verify_glance_signatures = enabled {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] volume_api_class = cinder.volume.api.API {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] volume_backend_name = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] volume_clear = zero {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] volume_clear_ionice = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] volume_clear_size = 0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] volume_copy_bps_limit = 0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] volume_dd_blocksize = 1M {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] volume_name_template = volume-%s {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] volume_service_inithost_offload = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] volume_usage_audit_period = month {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] zoning_mode = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_concurrency.disable_process_locking = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.auth_section = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.auth_type = password {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.auth_version = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.cache = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.certfile = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.delay_auth_decision = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.http_connect_timeout = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.include_service_catalog = True {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.insecure = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.interface = public {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.keyfile = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.memcache_password = {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.memcache_username = {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.region_name = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.service_token_roles_required = True {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.service_type = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.token_cache_time = 300 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.142/identity {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.backend = dogpile.cache.null {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.backend_argument = **** {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.backend_expiration_time = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.config_prefix = cache.oslo {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.debug_cache_backend = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.enable_retry_client = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.enable_socket_keepalive = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.enabled = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.expiration_time = 600 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.hashclient_retry_attempts = 2 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.memcache_dead_retry = 300 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.memcache_pool_maxsize = 10 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.memcache_sasl_enabled = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.password = **** {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.proxies = [] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.redis_db = 0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.redis_sentinel_service_name = mymaster {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.redis_server = localhost:6379 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.retry_attempts = 2 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.retry_delay = 0.0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.socket_keepalive_count = 1 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.socket_keepalive_idle = 1 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.socket_keepalive_interval = 1 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.socket_timeout = 1.0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.tls_allowed_ciphers = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.tls_cafile = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.tls_certfile = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.tls_enabled = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.tls_keyfile = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cache.username = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] coordination.backend_url = **** {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] database.asyncio_connection = **** {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] database.asyncio_slave_connection = **** {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] database.backend = sqlalchemy {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] database.connection = **** {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] database.connection_debug = 0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] database.connection_parameters = {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] database.connection_recycle_time = 3600 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] database.connection_trace = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] database.db_inc_retry_interval = True {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] database.db_max_retries = 20 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] database.db_max_retry_interval = 10 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] database.db_retry_interval = 1 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] database.max_overflow = 50 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] database.max_pool_size = 5 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] database.max_retries = 10 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] database.mysql_wsrep_sync_wait = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] database.pool_timeout = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] database.retry_interval = 10 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] database.slave_connection = **** {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] database.sqlite_synchronous = True {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] database.synchronous_reader = True {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] database.use_db_reconnect = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] profiler.connection_string = messaging:// {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] profiler.enabled = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] profiler.es_doc_type = notification {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] profiler.es_scroll_size = 10000 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] profiler.es_scroll_time = 2m {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] profiler.filter_error_trace = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] profiler.hmac_keys = **** {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] profiler.sentinel_service_name = mymaster {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] profiler.socket_timeout = 0.1 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] profiler.trace_requests = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] profiler.trace_sqlalchemy = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] profiler_jaeger.process_tags = {} {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] profiler_jaeger.service_name_prefix = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] profiler_otlp.service_name_prefix = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_policy.enforce_new_defaults = True {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_policy.enforce_scope = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87375]: DEBUG cinder.volume.drivers.quobyte [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87375) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 10 00:21:44 devstack cinder-volume[87375]: WARNING cinder.volume.drivers.quobyte [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 10 00:21:44 devstack cinder-volume[87375]: WARNING cinder.volume.drivers.quobyte [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_policy.policy_default_rule = default {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_policy.policy_file = policy.yaml {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87375]: DEBUG oslo_concurrency.processutils [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Running cmd (subprocess): mount.quobyte {{(pid=87375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_policy.remote_timeout = 60.0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] privsep_osbrick.group = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] privsep_osbrick.helper_command = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] privsep_osbrick.user = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cinder_sys_admin.group = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cinder_sys_admin.helper_command = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] cinder_sys_admin.user = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] service_user.auth_section = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] service_user.auth_type = password {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] service_user.cafile = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] service_user.certfile = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] service_user.collect_timing = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] service_user.insecure = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] service_user.keyfile = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] service_user.send_service_user_token = True {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] service_user.split_loggers = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] service_user.timeout = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] glance.auth_section = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] glance.auth_type = password {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] glance.certfile = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] glance.collect_timing = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] glance.insecure = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] glance.keyfile = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] glance.region_name = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] glance.split_loggers = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] glance.timeout = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.backend_availability_zone = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.chap_password = **** {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.chap_username = {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.disk_geometry = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.driver_client_cert = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.driver_client_cert_key = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.driver_data_namespace = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.driver_use_ssl = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.enable_unsupported_driver = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.extra_capabilities = {} {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.filter_function = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.goodness_function = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.iscsi_target_flags = {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.iscsi_write_cache = on {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.iser_helper = tgtadm {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.iser_ip_address = 192.168.122.142 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.iser_port = 3260 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.nas_host = {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.nas_login = admin {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.nas_mount_options = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.nas_password = **** {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.nas_private_key = {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.nas_share_path = {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.nas_ssh_port = 22 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.num_shell_tries = 3 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.nvmet_port_id = 1 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.quobyte_client_cfg = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.quobyte_volume_url = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.replication_device = **** {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.report_discard_supported = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.reserved_percentage = 0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.scst_target_driver = iscsi {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.scst_target_iqn_name = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.storage_protocol = iSCSI {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.target_helper = tgtadm {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.target_ip_address = 192.168.122.142 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.target_port = 3260 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.target_protocol = iscsi {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.trace_flags = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.unique_fqdn_network = True {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.use_chap_auth = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.volume_backend_name = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.volume_clear = zero {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.volume_clear_ionice = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.volume_clear_size = 0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_reports.file_event_handler = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_reports.log_dir = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.backend_availability_zone = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.backend_host = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.chap_password = **** {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.chap_username = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.chiscsi_conf = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.disk_geometry = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.driver_client_cert = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.driver_client_cert_key = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.driver_data_namespace = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.driver_use_ssl = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.extra_capabilities = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.filter_function = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.goodness_function = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.iscsi_target_flags = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.iscsi_write_cache = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.iser_helper = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.iser_ip_address = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.iser_port = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.iser_target_prefix = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.nas_host = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.nas_login = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.nas_mount_options = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.nas_password = **** {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.nas_private_key = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.nas_share_path = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.nas_ssh_port = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.num_shell_tries = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.nvmet_ns_id = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.nvmet_port_id = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.replication_device = **** {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.report_discard_supported = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.reserved_percentage = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.scst_target_driver = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.storage_protocol = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack quobyte-client[87379]: Reading configuration file: /etc/quobyte/client.cfg Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.target_helper = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.target_ip_address = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.target_port = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.target_prefix = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.target_protocol = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.trace_flags = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack quobyte-client[87379]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.unique_fqdn_network = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.use_chap_auth = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.volume_clear = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.volume_clear_ionice = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.volume_clear_size = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] QuobyteHD.volumes_dir = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87375]: DEBUG oslo_concurrency.processutils [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] CMD "mount.quobyte" returned: 1 in 0.088s {{(pid=87375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.ssl = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87375]: DEBUG oslo_concurrency.lockutils [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87375) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87375]: DEBUG oslo_concurrency.lockutils [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87375) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:21:44 devstack cinder-volume[87375]: DEBUG cinder.volume.drivers.quobyte [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=87375) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:21:44 devstack cinder-volume[87375]: INFO cinder.volume.drivers.quobyte [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff ... Jul 10 00:21:44 devstack cinder-volume[87375]: DEBUG oslo_concurrency.processutils [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 -c /etc/quobyte/client-cinder.cfg {{(pid=87375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.ssl_version = {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_notifications.driver = [] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_notifications.retry = -1 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] oslo_messaging_notifications.transport_url = **** {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] key_manager.fixed_key = **** {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] barbican.barbican_api_version = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] barbican.barbican_endpoint = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] barbican.barbican_endpoint_type = public {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] barbican.barbican_region_name = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] barbican.cafile = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] barbican.certfile = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] barbican.collect_timing = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] barbican.insecure = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] barbican.keyfile = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] barbican.number_of_retries = 60 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] barbican.retry_delay = 1 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] barbican.send_service_user_token = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] barbican.split_loggers = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] barbican.timeout = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] barbican.verify_ssl = True {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] barbican.verify_ssl_path = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] barbican_service_user.auth_section = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] barbican_service_user.auth_type = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] barbican_service_user.cafile = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] barbican_service_user.certfile = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] barbican_service_user.collect_timing = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] barbican_service_user.insecure = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] barbican_service_user.keyfile = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] barbican_service_user.split_loggers = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] barbican_service_user.timeout = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] vault.approle_role_id = **** {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] vault.approle_secret_id = **** {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] vault.kv_mountpoint = secret {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] vault.kv_path = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] vault.kv_version = 2 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] vault.namespace = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] vault.root_token_id = **** {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] vault.ssl_ca_crt_file = None {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] vault.timeout = 60.0 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] vault.use_ssl = False {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:21:44 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] ******************************************************************************** {{(pid=87157) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 00:21:44 devstack sudo[87381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 -c /etc/quobyte/client-cinder.cfg Jul 10 00:21:44 devstack sudo[87381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:21:45 devstack sudo[87381]: pam_unix(sudo:session): session closed for user root Jul 10 00:21:45 devstack cinder-volume[87375]: DEBUG oslo_concurrency.processutils [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.747s {{(pid=87375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:21:45 devstack cinder-volume[87375]: INFO cinder.volume.drivers.quobyte [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff succeeded Jul 10 00:21:45 devstack cinder-volume[87375]: DEBUG cinder.volume.drivers.quobyte [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=87375) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:21:45 devstack cinder-volume[87375]: DEBUG oslo_concurrency.lockutils [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.760s {{(pid=87375) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:21:45 devstack cinder-volume[87375]: DEBUG oslo_concurrency.processutils [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=87375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:21:45 devstack sudo[87450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:21:45 devstack sudo[87450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:21:46 devstack sudo[87450]: pam_unix(sudo:session): session closed for user root Jul 10 00:21:46 devstack cinder-volume[87375]: DEBUG oslo_concurrency.processutils [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.611s {{(pid=87375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:21:46 devstack cinder-volume[87375]: INFO cinder.volume.driver [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Driver hasn't implemented _init_vendor_properties() Jul 10 00:21:46 devstack cinder-volume[87375]: DEBUG cinder.volume.driver [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87375) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 00:21:46 devstack cinder-volume[87375]: DEBUG oslo_db.sqlalchemy.engines [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87375) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 00:21:46 devstack cinder-volume[87375]: DEBUG dbcounter [-] [87375] Writer thread running {{(pid=87375) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 00:21:46 devstack cinder-volume[87375]: DEBUG cinder.db.api [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Building query based on filter {{(pid=87375) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 00:21:46 devstack cinder-volume[87375]: DEBUG cinder.image.image_utils [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87375) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 00:21:46 devstack cinder-volume[87375]: INFO cinder.keymgr.migration [None req-0c953e91-eb05-4672-8a3f-d2d990dfaeea None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 00:21:46 devstack cinder-volume[87375]: DEBUG oslo_concurrency.lockutils [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87375) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:21:46 devstack cinder-volume[87375]: DEBUG oslo_concurrency.lockutils [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87375) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:21:46 devstack cinder-volume[87375]: DEBUG cinder.volume.drivers.quobyte [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=87375) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:21:46 devstack cinder-volume[87375]: DEBUG cinder.volume.drivers.quobyte [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=87375) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:21:46 devstack cinder-volume[87375]: DEBUG oslo_concurrency.lockutils [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87375) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:21:46 devstack cinder-volume[87375]: DEBUG oslo_concurrency.processutils [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=87375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:21:46 devstack sudo[87453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:21:46 devstack sudo[87453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:21:46 devstack sudo[87453]: pam_unix(sudo:session): session closed for user root Jul 10 00:21:46 devstack cinder-volume[87375]: DEBUG oslo_concurrency.processutils [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.607s {{(pid=87375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:21:46 devstack cinder-volume[87375]: DEBUG cinder.manager [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Notifying Schedulers of capabilities ... {{(pid=87375) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:21:46 devstack cinder-volume[87375]: INFO cinder.volume.manager [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Driver initialization completed successfully. Jul 10 00:21:46 devstack cinder-volume[87375]: INFO cinder.manager [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Initiating service 3 cleanup Jul 10 00:21:46 devstack cinder-volume[87375]: INFO cinder.manager [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Service 3 cleanup completed. Jul 10 00:21:46 devstack cinder-volume[87375]: DEBUG cinder.service [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Creating RPC server for service cinder-volume {{(pid=87375) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 00:21:46 devstack cinder-volume[87375]: DEBUG cinder.service [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87375) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 00:21:47 devstack cinder-volume[87375]: INFO cinder.volume.manager [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 10 00:21:47 devstack cinder-volume[87375]: DEBUG oslo_concurrency.lockutils [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87375) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:21:47 devstack cinder-volume[87375]: DEBUG oslo_concurrency.lockutils [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87375) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:21:47 devstack cinder-volume[87375]: DEBUG cinder.volume.drivers.quobyte [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=87375) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:21:47 devstack cinder-volume[87375]: DEBUG cinder.volume.drivers.quobyte [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=87375) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:21:47 devstack cinder-volume[87375]: DEBUG oslo_concurrency.lockutils [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87375) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:21:47 devstack cinder-volume[87375]: DEBUG oslo_concurrency.processutils [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=87375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:21:47 devstack sudo[87462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:21:47 devstack sudo[87462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:21:47 devstack sudo[87462]: pam_unix(sudo:session): session closed for user root Jul 10 00:21:47 devstack cinder-volume[87375]: DEBUG oslo_concurrency.processutils [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.758s {{(pid=87375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:21:47 devstack cinder-volume[87375]: INFO cinder.volume.manager [None req-3d92a4cd-64a8-4d1c-bcc2-34ac4d8eb83b None None] Driver post RPC initialization completed successfully. Jul 10 00:21:52 devstack cinder-volume[87375]: DEBUG oslo_concurrency.lockutils [None req-edf05448-a8ed-4ed3-8b29-7c594d0615cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87375) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:21:52 devstack cinder-volume[87375]: DEBUG oslo_concurrency.lockutils [None req-edf05448-a8ed-4ed3-8b29-7c594d0615cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87375) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:21:52 devstack cinder-volume[87375]: DEBUG cinder.volume.drivers.quobyte [None req-edf05448-a8ed-4ed3-8b29-7c594d0615cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=87375) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:21:52 devstack cinder-volume[87375]: DEBUG cinder.volume.drivers.quobyte [None req-edf05448-a8ed-4ed3-8b29-7c594d0615cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=87375) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:21:52 devstack cinder-volume[87375]: DEBUG oslo_concurrency.lockutils [None req-edf05448-a8ed-4ed3-8b29-7c594d0615cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87375) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:21:52 devstack cinder-volume[87375]: DEBUG oslo_concurrency.processutils [None req-edf05448-a8ed-4ed3-8b29-7c594d0615cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=87375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:21:52 devstack sudo[87657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:21:52 devstack sudo[87657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:21:52 devstack sudo[87657]: pam_unix(sudo:session): session closed for user root Jul 10 00:21:52 devstack cinder-volume[87375]: DEBUG oslo_concurrency.processutils [None req-edf05448-a8ed-4ed3-8b29-7c594d0615cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.693s {{(pid=87375) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:21:52 devstack cinder-volume[87375]: DEBUG cinder.manager [None req-edf05448-a8ed-4ed3-8b29-7c594d0615cb None None] Notifying Schedulers of capabilities ... {{(pid=87375) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:21:54 devstack cinder-volume[87157]: DEBUG dbcounter [-] [87157] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=87157) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:21:54 devstack cinder-volume[87157]: INFO oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] Caught SIGTERM, stopping children Jul 10 00:21:54 devstack cinder-volume[87157]: DEBUG oslo_concurrency.lockutils [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] Acquiring lock "singleton_lock" {{(pid=87157) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 00:21:54 devstack cinder-volume[87157]: DEBUG oslo_concurrency.lockutils [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] Acquired lock "singleton_lock" {{(pid=87157) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 00:21:54 devstack cinder-volume[87157]: DEBUG oslo_concurrency.lockutils [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] Releasing lock "singleton_lock" {{(pid=87157) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 00:21:54 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] Stop services. {{(pid=87157) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 10 00:21:54 devstack cinder-volume[87157]: DEBUG oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] Killing children. {{(pid=87157) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 10 00:21:54 devstack cinder-volume[87157]: INFO oslo_service.backend._eventlet.service [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] Waiting on 1 children to exit Jul 10 00:21:57 devstack cinder-volume[87375]: DEBUG dbcounter [-] [87375] Writing DB stats cinder:SELECT=5 {{(pid=87375) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:21:57 devstack cinder-volume[87375]: DEBUG dbcounter [-] [87375] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=87375) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:21:59 devstack cinder-volume[87375]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 10 00:22:00 devstack cinder-volume[87375]: DEBUG oslo_concurrency.lockutils [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] Acquiring lock "singleton_lock" {{(pid=87375) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 00:22:00 devstack cinder-volume[87375]: DEBUG oslo_concurrency.lockutils [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] Acquired lock "singleton_lock" {{(pid=87375) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 00:22:00 devstack cinder-volume[87375]: DEBUG oslo_concurrency.lockutils [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] Releasing lock "singleton_lock" {{(pid=87375) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 00:22:00 devstack cinder-volume[87375]: WARNING amqp [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 00:22:00 devstack cinder-volume[87375]: WARNING amqp [None req-77c238c3-e9d3-4370-ba01-865cde98d73a None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 00:22:00 devstack cinder-volume[87869]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 00:22:00 devstack cinder-volume[87869]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 00:22:00 devstack cinder-volume[87869]: we strongly recommend against using it for new projects. Jul 10 00:22:00 devstack cinder-volume[87869]: If you are already using Eventlet, we recommend migrating to a different Jul 10 00:22:00 devstack cinder-volume[87869]: framework. For more detail see Jul 10 00:22:00 devstack cinder-volume[87869]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 00:22:00 devstack cinder-volume[87869]: import eventlet # noqa Jul 10 00:22:02 devstack cinder-volume[87869]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87869) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 00:22:02 devstack cinder-volume[87869]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87869) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 00:22:02 devstack cinder-volume[87869]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87869) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 00:22:03 devstack cinder-volume[87869]: INFO dbcounter [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] Registered counter for database cinder Jul 10 00:22:03 devstack cinder-volume[87869]: DEBUG oslo_db.sqlalchemy.engines [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87869) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG dbcounter [-] [87869] Writer thread running {{(pid=87869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 00:22:04 devstack cinder-volume[87869]: INFO cinder.rpc [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 00:22:04 devstack cinder-volume[87869]: INFO cinder.rpc [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_db.sqlalchemy.engines [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87869) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 00:22:04 devstack cinder-volume[87869]: INFO cinder.volume.manager [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] Determined volume DB was empty at startup. Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG cinder.volume.manager [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87869) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 00:22:04 devstack cinder-volume[87869]: WARNING stevedore.named [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 00:22:04 devstack cinder-volume[87869]: WARNING castellan.key_manager [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 00:22:04 devstack cinder-volume[87869]: WARNING cinder.keymgr.conf_key_mgr [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 00:22:04 devstack cinder-volume[87869]: INFO cinder.volume.manager [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_db.sqlalchemy.engines [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87869) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 00:22:04 devstack cinder-volume[87869]: INFO oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] Starting 1 workers Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] Started child 88119 {{(pid=87869) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] Full set of CONF: {{(pid=87869) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] ******************************************************************************** {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] Configuration options gathered from: {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] ================================================================================ {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] allow_availability_zone_fallback = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] allow_compression_on_image_upload = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] allowed_direct_url_schemes = [] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] api_rate_limit = True {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] auth_strategy = keystone {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_availability_zone = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_host = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_name = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_stats_polling_interval = 60 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backup_api_class = cinder.backup.api.API {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backup_name_template = backup-%s {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[88119]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backup_use_same_host = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backup_use_temp_snapshot = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] chap_password = **** {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] chap_username = {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cinder_internal_tenant_project_id = 8faef378b3554e049342c051a70e50cd {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cinder_internal_tenant_user_id = 2e83a4399c47451d9282aaf4a5ff0db9 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cluster = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] compression_format = gzip {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] compute_api_class = cinder.compute.nova.API {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] config_dir = [] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] config_source = [] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] control_exchange = openstack {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] debug = True {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] default_availability_zone = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] default_group_type = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] default_volume_type = QuobyteHD {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] disk_geometry = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] driver_client_cert = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] driver_client_cert_key = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] driver_data_namespace = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] driver_ssl_cert_path = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] driver_ssl_cert_verify = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] driver_use_ssl = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] enable_new_services = True {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] enable_unsupported_driver = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] enabled_backends = ['QuobyteHD'] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] enforce_multipath_for_image_xfer = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] filter_function = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] glance_api_insecure = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] glance_api_servers = ['http://192.168.122.142/image'] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] glance_api_ssl_compression = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] glance_ca_certificates_file = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] glance_catalog_info = image:glance:publicURL {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] glance_certfile = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] glance_keyfile = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] glance_num_retries = 3 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] glance_request_timeout = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] goodness_function = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] graceful_shutdown_timeout = 5 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] group_api_class = cinder.group.api.API {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] host = devstack {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] image_compress_on_upload = True {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] image_conversion_address_space_limit = 1 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] image_conversion_cpu_limit = 60 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] image_conversion_disable = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] image_upload_use_cinder_backend = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] image_upload_use_internal_tenant = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] image_volume_cache_enabled = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] image_volume_cache_max_count = 0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Starting volume driver QuobyteDriver (1.1.14) Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] image_volume_cache_max_size_gb = 0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] init_host_max_objects_retrieval = 0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] instance_format = [instance: %(uuid)s] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] iscsi_target_flags = {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] iscsi_write_cache = on {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88119) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] iser_helper = tgtadm {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] iser_ip_address = 192.168.122.142 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] iser_port = 3260 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] log_color = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] log_config_append = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] log_dir = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] log_file = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] log_options = True {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] log_rotate_interval = 1 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] log_rotate_interval_type = days {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] log_rotation_type = none {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] max_age = 0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] max_logfile_count = 30 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] max_logfile_size_mb = 200 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] max_over_subscription_ratio = 20.0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] message_reap_interval = 86400 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] message_ttl = 2592000 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] migration_create_volume_timeout_secs = 300 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] monkey_patch = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] monkey_patch_modules = [] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] my_ip = 192.168.122.142 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] no_snapshot_gb_quota = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] num_iser_scan_tries = 3 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] num_shell_tries = 3 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] num_volume_device_scan_tries = 3 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] nvmeof_conn_info_version = 1 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] nvmet_ns_id = 10 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] nvmet_port_id = 1 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] osapi_max_limit = 1000 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] osapi_volume_ext_list = [] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] osapi_volume_listen = 0.0.0.0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] osapi_volume_listen_port = 8776 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] osapi_volume_use_ssl = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] osapi_volume_workers = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] per_volume_size_limit = -1 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] periodic_fuzzy_delay = 60 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] periodic_interval = 60 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] project_id_regex = [0-9a-f\-]+ {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] public_endpoint = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] publish_errors = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] quota_backup_gigabytes = 1000 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] quota_backups = 10 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] quota_gigabytes = 1000 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] quota_groups = 10 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] quota_snapshots = 10 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] quota_volumes = 10 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] rate_limit_burst = 0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] rate_limit_except_level = CRITICAL {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] rate_limit_interval = 0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] reinit_driver_count = 3 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] replication_device = **** {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] report_discard_supported = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] report_interval = 120 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] reservation_clean_interval = 86400 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] reservation_expire = 86400 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] reserved_image_namespaces = [] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] reserved_percentage = 0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] rpc_response_timeout = 120 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] run_external_periodic_tasks = True {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] scst_target_driver = iscsi {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] scst_target_iqn_name = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] service_down_time = 720 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] shell_completion = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] snapshot_name_template = snapshot-%s {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] split_loggers = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] state_path = /opt/stack/data/cinder {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] storage_availability_zone = nova {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] storage_protocol = iSCSI {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] syslog_log_facility = LOG_USER {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] target_helper = lioadm {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] target_ip_address = 192.168.122.142 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] target_port = 3260 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] target_protocol = iscsi {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] target_secondary_ip_addresses = [] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] trace_flags = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] transfer_api_class = cinder.transfer.api.API {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] transport_url = **** {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] until_refresh = 0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] use_chap_auth = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] use_default_quota_class = True {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] use_journal = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] use_json = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] use_multipath_for_image_xfer = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] use_stderr = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] use_syslog = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] verify_glance_signatures = enabled {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] volume_api_class = cinder.volume.api.API {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] volume_backend_name = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] volume_clear = zero {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] volume_clear_ionice = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] volume_clear_size = 0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] volume_copy_bps_limit = 0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] volume_dd_blocksize = 1M {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] volume_name_template = volume-%s {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] volume_service_inithost_offload = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] volume_usage_audit_period = month {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] zoning_mode = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_concurrency.disable_process_locking = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.auth_section = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.auth_type = password {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.auth_version = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.cache = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.certfile = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.delay_auth_decision = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.http_connect_timeout = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.include_service_catalog = True {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.insecure = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.interface = public {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.keyfile = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.memcache_password = {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88119) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 10 00:22:04 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.quobyte [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.quobyte [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Running cmd (subprocess): mount.quobyte {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.memcache_username = {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.region_name = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.service_token_roles_required = True {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.service_type = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.token_cache_time = 300 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.142/identity {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.backend = dogpile.cache.null {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.backend_argument = **** {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.backend_expiration_time = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.config_prefix = cache.oslo {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.debug_cache_backend = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.enable_retry_client = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.enable_socket_keepalive = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.enabled = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.expiration_time = 600 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.hashclient_retry_attempts = 2 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.memcache_dead_retry = 300 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.memcache_pool_maxsize = 10 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.memcache_sasl_enabled = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.password = **** {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.proxies = [] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.redis_db = 0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.redis_sentinel_service_name = mymaster {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.redis_server = localhost:6379 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.retry_attempts = 2 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.retry_delay = 0.0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.socket_keepalive_count = 1 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.socket_keepalive_idle = 1 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.socket_keepalive_interval = 1 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.socket_timeout = 1.0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.tls_allowed_ciphers = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.tls_cafile = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.tls_certfile = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.tls_enabled = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.tls_keyfile = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cache.username = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] coordination.backend_url = **** {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] database.asyncio_connection = **** {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] database.asyncio_slave_connection = **** {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] database.backend = sqlalchemy {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] database.connection = **** {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] database.connection_debug = 0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] database.connection_parameters = {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] database.connection_recycle_time = 3600 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] database.connection_trace = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] database.db_inc_retry_interval = True {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] database.db_max_retries = 20 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] database.db_max_retry_interval = 10 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] database.db_retry_interval = 1 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] database.max_overflow = 50 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] database.max_pool_size = 5 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] database.max_retries = 10 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] database.mysql_wsrep_sync_wait = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] database.pool_timeout = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] database.retry_interval = 10 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] database.slave_connection = **** {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] database.sqlite_synchronous = True {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] database.synchronous_reader = True {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] database.use_db_reconnect = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] profiler.connection_string = messaging:// {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] profiler.enabled = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] profiler.es_doc_type = notification {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] profiler.es_scroll_size = 10000 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] profiler.es_scroll_time = 2m {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] profiler.filter_error_trace = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] profiler.hmac_keys = **** {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] profiler.sentinel_service_name = mymaster {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] profiler.socket_timeout = 0.1 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] profiler.trace_requests = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] profiler.trace_sqlalchemy = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] profiler_jaeger.process_tags = {} {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] profiler_jaeger.service_name_prefix = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] profiler_otlp.service_name_prefix = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_policy.enforce_new_defaults = True {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_policy.enforce_scope = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_policy.policy_default_rule = default {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_policy.policy_file = policy.yaml {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_policy.remote_timeout = 60.0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] privsep_osbrick.group = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] privsep_osbrick.helper_command = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] privsep_osbrick.user = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cinder_sys_admin.group = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cinder_sys_admin.helper_command = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] cinder_sys_admin.user = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] service_user.auth_section = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] service_user.auth_type = password {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] service_user.cafile = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] service_user.certfile = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] service_user.collect_timing = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] service_user.insecure = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] service_user.keyfile = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] service_user.send_service_user_token = True {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] service_user.split_loggers = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] service_user.timeout = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] glance.auth_section = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] glance.auth_type = password {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] glance.certfile = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] glance.collect_timing = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] glance.insecure = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] glance.keyfile = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] glance.region_name = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] glance.split_loggers = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] glance.timeout = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] CMD "mount.quobyte" returned: 1 in 0.062s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.backend_availability_zone = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.chap_password = **** {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.chap_username = {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.disk_geometry = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.driver_client_cert = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.driver_client_cert_key = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.driver_data_namespace = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.driver_use_ssl = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.enable_unsupported_driver = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.extra_capabilities = {} {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.filter_function = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.goodness_function = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.iscsi_target_flags = {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.iscsi_write_cache = on {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.iser_helper = tgtadm {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.iser_ip_address = 192.168.122.142 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.iser_port = 3260 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.nas_host = {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.nas_login = admin {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.nas_mount_options = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.nas_password = **** {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.nas_private_key = {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.nas_share_path = {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.nas_ssh_port = 22 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.num_shell_tries = 3 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.nvmet_port_id = 1 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.quobyte_client_cfg = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.quobyte_volume_url = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.replication_device = **** {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.report_discard_supported = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.reserved_percentage = 0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.scst_target_driver = iscsi {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.scst_target_iqn_name = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.storage_protocol = iSCSI {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.target_helper = tgtadm {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.target_ip_address = 192.168.122.142 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.target_port = 3260 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.target_protocol = iscsi {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.trace_flags = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.unique_fqdn_network = True {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.use_chap_auth = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.volume_backend_name = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.volume_clear = zero {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.volume_clear_ionice = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.volume_clear_size = 0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_reports.file_event_handler = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_reports.log_dir = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.backend_availability_zone = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.backend_host = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack sudo[88125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.chap_password = **** {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.chap_username = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.chiscsi_conf = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.disk_geometry = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.driver_client_cert = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.driver_client_cert_key = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.driver_data_namespace = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.driver_use_ssl = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.extra_capabilities = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.filter_function = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.goodness_function = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.iscsi_target_flags = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.iscsi_write_cache = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.iser_helper = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.iser_ip_address = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.iser_port = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.iser_target_prefix = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.nas_host = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.nas_login = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.nas_mount_options = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.nas_password = **** {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.nas_private_key = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.nas_share_path = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.nas_ssh_port = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.num_shell_tries = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.nvmet_ns_id = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.nvmet_port_id = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.replication_device = **** {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.report_discard_supported = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.reserved_percentage = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.scst_target_driver = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.storage_protocol = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.target_helper = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.target_ip_address = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.target_port = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.target_prefix = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.target_protocol = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.trace_flags = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.unique_fqdn_network = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.use_chap_auth = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.volume_clear = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.volume_clear_ionice = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.volume_clear_size = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] QuobyteHD.volumes_dir = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.ssl = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.ssl_version = {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_notifications.driver = [] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_notifications.retry = -1 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] oslo_messaging_notifications.transport_url = **** {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] key_manager.fixed_key = **** {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] barbican.barbican_api_version = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] barbican.barbican_endpoint = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] barbican.barbican_endpoint_type = public {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] barbican.barbican_region_name = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] barbican.cafile = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] barbican.certfile = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] barbican.collect_timing = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] barbican.insecure = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] barbican.keyfile = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] barbican.number_of_retries = 60 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] barbican.retry_delay = 1 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] barbican.send_service_user_token = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] barbican.split_loggers = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] barbican.timeout = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] barbican.verify_ssl = True {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] barbican.verify_ssl_path = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] barbican_service_user.auth_section = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] barbican_service_user.auth_type = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] barbican_service_user.cafile = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] barbican_service_user.certfile = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] barbican_service_user.collect_timing = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] barbican_service_user.insecure = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] barbican_service_user.keyfile = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] barbican_service_user.split_loggers = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] barbican_service_user.timeout = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] vault.approle_role_id = **** {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] vault.approle_secret_id = **** {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] vault.kv_mountpoint = secret {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] vault.kv_path = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] vault.kv_version = 2 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] vault.namespace = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] vault.root_token_id = **** {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] vault.ssl_ca_crt_file = None {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] vault.timeout = 60.0 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] vault.use_ssl = False {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 00:22:04 devstack cinder-volume[87869]: DEBUG oslo_service.backend._eventlet.service [None req-e4353b43-6eca-4467-a32a-53d419f68d8d None None] ******************************************************************************** {{(pid=87869) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 00:22:05 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root Jul 10 00:22:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.589s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:22:05 devstack cinder-volume[88119]: INFO cinder.volume.driver [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Driver hasn't implemented _init_vendor_properties() Jul 10 00:22:05 devstack cinder-volume[88119]: DEBUG cinder.volume.driver [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88119) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 00:22:05 devstack cinder-volume[88119]: DEBUG oslo_db.sqlalchemy.engines [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88119) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 00:22:05 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writer thread running {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 00:22:05 devstack cinder-volume[88119]: DEBUG cinder.db.api [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Building query based on filter {{(pid=88119) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 00:22:05 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88119) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 00:22:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:22:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:22:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:22:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:22:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:22:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:22:05 devstack cinder-volume[88119]: INFO cinder.keymgr.migration [None req-2c3d7d64-4488-42c4-b0ea-4452a17a4207 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 00:22:05 devstack sudo[88129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:22:05 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:22:05 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root Jul 10 00:22:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.601s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:22:05 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:22:05 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Driver initialization completed successfully. Jul 10 00:22:05 devstack cinder-volume[88119]: INFO cinder.manager [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Initiating service 3 cleanup Jul 10 00:22:05 devstack cinder-volume[88119]: INFO cinder.manager [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Service 3 cleanup completed. Jul 10 00:22:05 devstack cinder-volume[88119]: DEBUG cinder.service [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Creating RPC server for service cinder-volume {{(pid=88119) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 00:22:05 devstack cinder-volume[88119]: DEBUG cinder.service [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88119) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 00:22:05 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 10 00:22:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:22:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:22:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:22:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:22:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:22:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:22:05 devstack sudo[88162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:22:05 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:22:06 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root Jul 10 00:22:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.615s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:22:06 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-21aca983-740a-48a1-a0d9-0cce0f8767ab None None] Driver post RPC initialization completed successfully. Jul 10 00:22:14 devstack cinder-volume[87869]: DEBUG dbcounter [-] [87869] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:22:15 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=2 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:22:16 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:22:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:22:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 6 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:22:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:23:03 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:23:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Flow 'volume_create_manager' (55b664ce-a27a-4eb5-854b-dcbf9de69b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:23:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37128849-aadd-4098-a42b-384666bb88d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:23:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37128849-aadd-4098-a42b-384666bb88d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1724742325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b1ff83ad3344cd83aefff8e4329bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:23:04Z,use_quota=True,user_id='27e2ce41b06e4b2993da33f7c2b42b2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:23:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2abeb22e-8753-4d52-b494-7802b542e641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:23:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2abeb22e-8753-4d52-b494-7802b542e641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:23:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8584b3b-b7f5-4646-82ef-3ae2dbb9d7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:23:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8584b3b-b7f5-4646-82ef-3ae2dbb9d7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb', 'volume_name': 'volume-ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:23:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5881928-8546-460e-8389-4b62ca3522eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:23:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5881928-8546-460e-8389-4b62ca3522eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:23:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9814c81f-4e28-4486-ab00-9b337f6931dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:23:04 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Volume ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb', 'volume_size': 1} Jul 10 00:23:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:23:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:23:04 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1724742325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b1ff83ad3344cd83aefff8e4329bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:23:04Z,use_quota=True,user_id='27e2ce41b06e4b2993da33f7c2b42b2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:23:04 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Creating volume ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:23:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:23:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:23:04 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:23:04 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:23:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:23:04 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:23:04 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:23:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:23:04 devstack sudo[88365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb 1073741824 Jul 10 00:23:04 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:23:05 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root Jul 10 00:23:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb 1073741824" returned: 0 in 1.048s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:23:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:23:05 devstack sudo[88687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb Jul 10 00:23:05 devstack sudo[88687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:23:06 devstack sudo[88687]: pam_unix(sudo:session): session closed for user root Jul 10 00:23:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb" returned: 0 in 0.808s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:23:06 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:23:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:23:06 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9814c81f-4e28-4486-ab00-9b337f6931dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:23:06 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8d9350-1f8f-48bb-9f41-3868b804de12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:23:06 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Volume volume-ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb (ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb): created successfully Jul 10 00:23:06 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8d9350-1f8f-48bb-9f41-3868b804de12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:23:06 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Flow 'volume_create_manager' (55b664ce-a27a-4eb5-854b-dcbf9de69b42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:23:06 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-652100c7-5d6f-4fda-85fe-f18ff16bb7cc tempest-TaggedAttachmentsTest-259487641 None] Created volume successfully. Jul 10 00:23:16 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:23:16 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:23:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:23:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:23:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:23:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:23:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:23:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:23:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:23:31 devstack sudo[89017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:23:31 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:23:33 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root Jul 10 00:23:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.728s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:23:33 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:23:33 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:23:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 6 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:23:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:23:39 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:23:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Flow 'volume_create_manager' (c9527cc9-b60a-4ef1-87dd-5d0b1eaff800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:23:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce545c8-691c-49ed-a509-55733753195a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:23:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce545c8-691c-49ed-a509-55733753195a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1834765907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eb9a03a-9d6c-4dca-a02d-da769b95671f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0acb6ac3ad1a415da2c9940f64e9eaa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:23:39Z,use_quota=True,user_id='88eed5c543114e3aa0a39bce235c4a22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:23:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078987db-4017-4092-beb2-785158bff84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:23:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078987db-4017-4092-beb2-785158bff84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:23:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f736a8-9d40-4306-b4cc-51273cd073ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:23:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f736a8-9d40-4306-b4cc-51273cd073ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eb9a03a-9d6c-4dca-a02d-da769b95671f', 'volume_name': 'volume-8eb9a03a-9d6c-4dca-a02d-da769b95671f', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:23:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc23b180-b56a-4881-ad9c-a357a193465f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:23:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc23b180-b56a-4881-ad9c-a357a193465f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:23:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04af8342-a3b9-4b58-aef3-a0d4e61e16d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:23:40 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Volume 8eb9a03a-9d6c-4dca-a02d-da769b95671f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eb9a03a-9d6c-4dca-a02d-da769b95671f', 'volume_size': 1} Jul 10 00:23:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:23:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:23:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1834765907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eb9a03a-9d6c-4dca-a02d-da769b95671f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0acb6ac3ad1a415da2c9940f64e9eaa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:23:39Z,use_quota=True,user_id='88eed5c543114e3aa0a39bce235c4a22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:23:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Creating volume 8eb9a03a-9d6c-4dca-a02d-da769b95671f {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:23:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:23:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:23:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:23:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:23:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:23:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:23:40 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:23:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8eb9a03a-9d6c-4dca-a02d-da769b95671f 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:23:40 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8eb9a03a-9d6c-4dca-a02d-da769b95671f 1073741824 Jul 10 00:23:40 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:23:42 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Jul 10 00:23:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8eb9a03a-9d6c-4dca-a02d-da769b95671f 1073741824" returned: 0 in 2.385s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:23:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8eb9a03a-9d6c-4dca-a02d-da769b95671f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:23:42 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8eb9a03a-9d6c-4dca-a02d-da769b95671f Jul 10 00:23:42 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:23:44 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Jul 10 00:23:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8eb9a03a-9d6c-4dca-a02d-da769b95671f" returned: 0 in 1.808s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:23:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] <== create_volume: return (4293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:23:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.300s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:23:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04af8342-a3b9-4b58-aef3-a0d4e61e16d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eb9a03a-9d6c-4dca-a02d-da769b95671f', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:23:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86dc2f9-e2ad-4e6c-a469-627cef5195e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:23:44 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Volume volume-8eb9a03a-9d6c-4dca-a02d-da769b95671f (8eb9a03a-9d6c-4dca-a02d-da769b95671f): created successfully Jul 10 00:23:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86dc2f9-e2ad-4e6c-a469-627cef5195e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:23:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Flow 'volume_create_manager' (c9527cc9-b60a-4ef1-87dd-5d0b1eaff800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:23:44 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-2282d4d5-5d56-4d64-9c35-7f333cfbc4e5 tempest-VolumesAdminNegativeTest-2062636250 None] Created volume successfully. Jul 10 00:23:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f4985333-4a99-41c0-bf16-d43eb3ebdeb0 tempest-VolumesAdminNegativeTest-2062636250 None] Acquiring lock "cinder-8eb9a03a-9d6c-4dca-a02d-da769b95671f-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:23:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f4985333-4a99-41c0-bf16-d43eb3ebdeb0 tempest-VolumesAdminNegativeTest-2062636250 None] Lock "cinder-8eb9a03a-9d6c-4dca-a02d-da769b95671f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:23:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f4985333-4a99-41c0-bf16-d43eb3ebdeb0 tempest-VolumesAdminNegativeTest-2062636250 None] Acquiring lock "cinder-quobyte-8eb9a03a-9d6c-4dca-a02d-da769b95671f" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:23:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f4985333-4a99-41c0-bf16-d43eb3ebdeb0 tempest-VolumesAdminNegativeTest-2062636250 None] Lock "cinder-quobyte-8eb9a03a-9d6c-4dca-a02d-da769b95671f" acquired by "delete_volume" :: waited 0.020s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:23:46 devstack cinder-volume[88119]: INFO oslo.privsep.daemon [None req-f4985333-4a99-41c0-bf16-d43eb3ebdeb0 tempest-VolumesAdminNegativeTest-2062636250 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmplefl3d3g/privsep.sock'] Jul 10 00:23:46 devstack sudo[89242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmplefl3d3g/privsep.sock Jul 10 00:23:46 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:23:47 devstack cinder-volume[88119]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 10 00:23:47 devstack cinder-volume[88119]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 00:23:47 devstack cinder-volume[88119]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 10 00:23:47 devstack cinder-volume[88119]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 00:23:47 devstack cinder-volume[88119]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 10 00:23:47 devstack cinder-volume[88119]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 10 00:23:47 devstack cinder-volume[88119]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 00:23:47 devstack cinder-volume[88119]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 00:23:47 devstack cinder-volume[88119]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 10 00:23:49 devstack cinder-volume[88119]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 10 00:23:49 devstack cinder-volume[88119]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 00:23:49 devstack cinder-volume[88119]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 10 00:23:49 devstack cinder-volume[88119]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 00:23:49 devstack cinder-volume[88119]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 10 00:23:49 devstack cinder-volume[88119]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 10 00:23:49 devstack cinder-volume[88119]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 00:23:49 devstack cinder-volume[88119]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 00:23:49 devstack cinder-volume[88119]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 10 00:23:50 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root Jul 10 00:23:50 devstack cinder-volume[88119]: INFO oslo.privsep.daemon [None req-f4985333-4a99-41c0-bf16-d43eb3ebdeb0 tempest-VolumesAdminNegativeTest-2062636250 None] Spawned new privsep daemon via rootwrap Jul 10 00:23:50 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [None req-f4985333-4a99-41c0-bf16-d43eb3ebdeb0 tempest-VolumesAdminNegativeTest-2062636250 None] Accepted privsep connection to /tmp/tmplefl3d3g/privsep.sock {{(pid=88119) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 10 00:23:50 devstack cinder-volume[88119]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 10 00:23:50 devstack cinder-volume[88119]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 10 00:23:50 devstack cinder-volume[88119]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 10 00:23:50 devstack cinder-volume[88119]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89253 Jul 10 00:23:50 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[36eaa448-a8a4-4bcf-9e7e-cbae8115199c]: (2,) {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:23:50 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3550f8-9852-4af4-82a4-bca82200aabc]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:23:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f4985333-4a99-41c0-bf16-d43eb3ebdeb0 tempest-VolumesAdminNegativeTest-2062636250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8eb9a03a-9d6c-4dca-a02d-da769b95671f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:23:50 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:23:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Flow 'volume_create_manager' (f7705ff7-31f6-483f-8e72-7a9f1e81a91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:23:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff50d200-851c-4779-949c-771a96ea06a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:23:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff50d200-851c-4779-949c-771a96ea06a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-133880739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59c0ed6e-d369-4b2a-b435-02680d606392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb2b436bbe1e4688a8699f48073e59a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:23:50Z,use_quota=True,user_id='c1027d33916d41b6bfa67d11adcb36fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:23:50 devstack sudo[89256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8eb9a03a-9d6c-4dca-a02d-da769b95671f Jul 10 00:23:50 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:23:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69cc7383-7630-4eb7-b1cf-1317c1f9f08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:23:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69cc7383-7630-4eb7-b1cf-1317c1f9f08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:23:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc6fe89-6835-46b1-8b6e-d568d088be53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:23:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc6fe89-6835-46b1-8b6e-d568d088be53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59c0ed6e-d369-4b2a-b435-02680d606392', 'volume_name': 'volume-59c0ed6e-d369-4b2a-b435-02680d606392', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:23:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1ca797-9d75-471b-aff5-98a09da7384a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:23:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1ca797-9d75-471b-aff5-98a09da7384a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:23:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1007f70a-9d78-4be1-92a8-8f32c3fa36e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:23:50 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Volume 59c0ed6e-d369-4b2a-b435-02680d606392: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59c0ed6e-d369-4b2a-b435-02680d606392', 'volume_size': 1} Jul 10 00:23:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:23:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:23:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-133880739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59c0ed6e-d369-4b2a-b435-02680d606392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb2b436bbe1e4688a8699f48073e59a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:23:50Z,use_quota=True,user_id='c1027d33916d41b6bfa67d11adcb36fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:23:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Creating volume 59c0ed6e-d369-4b2a-b435-02680d606392 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:23:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:23:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:23:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:23:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:23:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:23:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:23:50 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:23:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59c0ed6e-d369-4b2a-b435-02680d606392 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:23:50 devstack sudo[89258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59c0ed6e-d369-4b2a-b435-02680d606392 1073741824 Jul 10 00:23:50 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:23:52 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root Jul 10 00:23:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f4985333-4a99-41c0-bf16-d43eb3ebdeb0 tempest-VolumesAdminNegativeTest-2062636250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8eb9a03a-9d6c-4dca-a02d-da769b95671f" returned: 0 in 2.386s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:23:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f4985333-4a99-41c0-bf16-d43eb3ebdeb0 tempest-VolumesAdminNegativeTest-2062636250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8eb9a03a-9d6c-4dca-a02d-da769b95671f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:23:52 devstack sudo[89266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8eb9a03a-9d6c-4dca-a02d-da769b95671f Jul 10 00:23:52 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:23:53 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root Jul 10 00:23:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59c0ed6e-d369-4b2a-b435-02680d606392 1073741824" returned: 0 in 2.339s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:23:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59c0ed6e-d369-4b2a-b435-02680d606392 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:23:53 devstack sudo[89268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59c0ed6e-d369-4b2a-b435-02680d606392 Jul 10 00:23:53 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:23:54 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root Jul 10 00:23:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f4985333-4a99-41c0-bf16-d43eb3ebdeb0 tempest-VolumesAdminNegativeTest-2062636250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8eb9a03a-9d6c-4dca-a02d-da769b95671f" returned: 0 in 1.536s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:23:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f4985333-4a99-41c0-bf16-d43eb3ebdeb0 tempest-VolumesAdminNegativeTest-2062636250 None] Lock "cinder-quobyte-8eb9a03a-9d6c-4dca-a02d-da769b95671f" released by "delete_volume" :: held 7.612s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:23:54 devstack cinder-volume[88119]: WARNING cinder.quota [None req-f4985333-4a99-41c0-bf16-d43eb3ebdeb0 tempest-VolumesAdminNegativeTest-2062636250 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:23:54 devstack cinder-volume[88119]: WARNING cinder.quota [None req-f4985333-4a99-41c0-bf16-d43eb3ebdeb0 tempest-VolumesAdminNegativeTest-2062636250 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:23:54 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-f4985333-4a99-41c0-bf16-d43eb3ebdeb0 tempest-VolumesAdminNegativeTest-2062636250 None] Created reservations ['7d51ac99-7832-46dc-b924-0ca64e271590', 'cf18d0a0-bfac-4c96-b7e4-f2c010074255', 'b3316a65-219f-4f87-8e25-05fb7e1c3e6b', '4010426d-e949-44cf-bbb1-d1067d881fe8'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:23:54 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root Jul 10 00:23:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59c0ed6e-d369-4b2a-b435-02680d606392" returned: 0 in 1.515s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:23:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] <== create_volume: return (3991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:23:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:23:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f4985333-4a99-41c0-bf16-d43eb3ebdeb0 tempest-VolumesAdminNegativeTest-2062636250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:23:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f4985333-4a99-41c0-bf16-d43eb3ebdeb0 tempest-VolumesAdminNegativeTest-2062636250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:23:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f4985333-4a99-41c0-bf16-d43eb3ebdeb0 tempest-VolumesAdminNegativeTest-2062636250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:23:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f4985333-4a99-41c0-bf16-d43eb3ebdeb0 tempest-VolumesAdminNegativeTest-2062636250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:23:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f4985333-4a99-41c0-bf16-d43eb3ebdeb0 tempest-VolumesAdminNegativeTest-2062636250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:23:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f4985333-4a99-41c0-bf16-d43eb3ebdeb0 tempest-VolumesAdminNegativeTest-2062636250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:23:54 devstack sudo[89275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:23:54 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:23:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1007f70a-9d78-4be1-92a8-8f32c3fa36e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59c0ed6e-d369-4b2a-b435-02680d606392', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:23:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce4c2a78-102c-4d1c-b405-d4548eafcb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:23:54 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Volume volume-59c0ed6e-d369-4b2a-b435-02680d606392 (59c0ed6e-d369-4b2a-b435-02680d606392): created successfully Jul 10 00:23:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce4c2a78-102c-4d1c-b405-d4548eafcb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:23:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Flow 'volume_create_manager' (f7705ff7-31f6-483f-8e72-7a9f1e81a91f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:23:55 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-7d463bae-c734-4d71-a726-6bf0bcb08f4a tempest-ServerRescueNegativeTestJSON-946027985 None] Created volume successfully. Jul 10 00:23:56 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root Jul 10 00:23:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f4985333-4a99-41c0-bf16-d43eb3ebdeb0 tempest-VolumesAdminNegativeTest-2062636250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.653s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:23:56 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-f4985333-4a99-41c0-bf16-d43eb3ebdeb0 tempest-VolumesAdminNegativeTest-2062636250 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:23:56 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-f4985333-4a99-41c0-bf16-d43eb3ebdeb0 tempest-VolumesAdminNegativeTest-2062636250 None] Deleted volume successfully. Jul 10 00:23:56 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f4985333-4a99-41c0-bf16-d43eb3ebdeb0 tempest-VolumesAdminNegativeTest-2062636250 None] Lock "cinder-8eb9a03a-9d6c-4dca-a02d-da769b95671f-delete_volume" released by "delete_volume" :: held 10.016s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:24:05 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:UPDATE=15,cinder:SELECT=8,cinder:INSERT=3,cinder:DELETE=1 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:24:16 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-52508efe-e4c3-4ea9-9091-661b880ba8d9 tempest-ServerRescueNegativeTestJSON-946027985 None] Acquiring lock "cinder-59c0ed6e-d369-4b2a-b435-02680d606392-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:24:16 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-52508efe-e4c3-4ea9-9091-661b880ba8d9 tempest-ServerRescueNegativeTestJSON-946027985 None] Lock "cinder-59c0ed6e-d369-4b2a-b435-02680d606392-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:24:16 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-52508efe-e4c3-4ea9-9091-661b880ba8d9 tempest-ServerRescueNegativeTestJSON-946027985 None] Acquiring lock "cinder-quobyte-59c0ed6e-d369-4b2a-b435-02680d606392" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:24:16 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-52508efe-e4c3-4ea9-9091-661b880ba8d9 tempest-ServerRescueNegativeTestJSON-946027985 None] Lock "cinder-quobyte-59c0ed6e-d369-4b2a-b435-02680d606392" acquired by "delete_volume" :: waited 0.030s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:24:16 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab0ca0d-33ab-45f4-8d1a-6f38b4982eb8]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:24:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-52508efe-e4c3-4ea9-9091-661b880ba8d9 tempest-ServerRescueNegativeTestJSON-946027985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59c0ed6e-d369-4b2a-b435-02680d606392 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:16 devstack sudo[89492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59c0ed6e-d369-4b2a-b435-02680d606392 Jul 10 00:24:16 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:17 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-52508efe-e4c3-4ea9-9091-661b880ba8d9 tempest-ServerRescueNegativeTestJSON-946027985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59c0ed6e-d369-4b2a-b435-02680d606392" returned: 0 in 1.285s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-52508efe-e4c3-4ea9-9091-661b880ba8d9 tempest-ServerRescueNegativeTestJSON-946027985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59c0ed6e-d369-4b2a-b435-02680d606392 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:17 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59c0ed6e-d369-4b2a-b435-02680d606392 Jul 10 00:24:17 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:18 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-52508efe-e4c3-4ea9-9091-661b880ba8d9 tempest-ServerRescueNegativeTestJSON-946027985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59c0ed6e-d369-4b2a-b435-02680d606392" returned: 0 in 0.999s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:18 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-52508efe-e4c3-4ea9-9091-661b880ba8d9 tempest-ServerRescueNegativeTestJSON-946027985 None] Lock "cinder-quobyte-59c0ed6e-d369-4b2a-b435-02680d606392" released by "delete_volume" :: held 2.398s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:24:18 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-52508efe-e4c3-4ea9-9091-661b880ba8d9 tempest-ServerRescueNegativeTestJSON-946027985 None] Created reservations ['b684b423-cf71-4edc-8bc3-83ff0b2aaf7f', '8f0160e9-652f-49f5-91c4-09f2cfe354cb', '45f2b702-1319-43d6-957e-2d9b0d8edc7d', 'ccfcfe5c-9138-4145-8a95-3967f4a9dff9'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:24:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-52508efe-e4c3-4ea9-9091-661b880ba8d9 tempest-ServerRescueNegativeTestJSON-946027985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:24:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-52508efe-e4c3-4ea9-9091-661b880ba8d9 tempest-ServerRescueNegativeTestJSON-946027985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:24:18 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-52508efe-e4c3-4ea9-9091-661b880ba8d9 tempest-ServerRescueNegativeTestJSON-946027985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:24:18 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-52508efe-e4c3-4ea9-9091-661b880ba8d9 tempest-ServerRescueNegativeTestJSON-946027985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:24:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-52508efe-e4c3-4ea9-9091-661b880ba8d9 tempest-ServerRescueNegativeTestJSON-946027985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:24:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-52508efe-e4c3-4ea9-9091-661b880ba8d9 tempest-ServerRescueNegativeTestJSON-946027985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:19 devstack sudo[89557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:24:19 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:19 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-52508efe-e4c3-4ea9-9091-661b880ba8d9 tempest-ServerRescueNegativeTestJSON-946027985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.928s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:19 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-52508efe-e4c3-4ea9-9091-661b880ba8d9 tempest-ServerRescueNegativeTestJSON-946027985 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:24:19 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-52508efe-e4c3-4ea9-9091-661b880ba8d9 tempest-ServerRescueNegativeTestJSON-946027985 None] Deleted volume successfully. Jul 10 00:24:19 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-52508efe-e4c3-4ea9-9091-661b880ba8d9 tempest-ServerRescueNegativeTestJSON-946027985 None] Lock "cinder-59c0ed6e-d369-4b2a-b435-02680d606392-delete_volume" released by "delete_volume" :: held 3.738s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:24:28 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=16,cinder:INSERT=4,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:24:29 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:24:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:24:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:24:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:24:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:24:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:24:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:24:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:31 devstack sudo[89683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:24:31 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:32 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.091s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:32 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:24:45 devstack cinder-volume[88119]: WARNING py.warnings [req-3afa49f6-eebb-43c0-8854-eff54d0f4709 req-b291e650-f77b-44b0-99b0-43fd3d0bbd98 tempest-TaggedAttachmentsTest-259487641 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 10 00:24:45 devstack cinder-volume[88119]: .first() Jul 10 00:24:45 devstack cinder-volume[88119]: Jul 10 00:24:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-3afa49f6-eebb-43c0-8854-eff54d0f4709 req-b291e650-f77b-44b0-99b0-43fd3d0bbd98 tempest-TaggedAttachmentsTest-259487641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:24:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-3afa49f6-eebb-43c0-8854-eff54d0f4709 req-b291e650-f77b-44b0-99b0-43fd3d0bbd98 tempest-TaggedAttachmentsTest-259487641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:24:45 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e05d86d-5872-44b2-9010-4d8e3ad2c37e]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:24:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-3afa49f6-eebb-43c0-8854-eff54d0f4709 req-b291e650-f77b-44b0-99b0-43fd3d0bbd98 tempest-TaggedAttachmentsTest-259487641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:45 devstack sudo[89798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb Jul 10 00:24:45 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:46 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-3afa49f6-eebb-43c0-8854-eff54d0f4709 req-b291e650-f77b-44b0-99b0-43fd3d0bbd98 tempest-TaggedAttachmentsTest-259487641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb" returned: 0 in 0.965s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-3afa49f6-eebb-43c0-8854-eff54d0f4709 req-b291e650-f77b-44b0-99b0-43fd3d0bbd98 tempest-TaggedAttachmentsTest-259487641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.986s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:24:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-3afa49f6-eebb-43c0-8854-eff54d0f4709 req-b291e650-f77b-44b0-99b0-43fd3d0bbd98 tempest-TaggedAttachmentsTest-259487641 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff', 'name': 'volume-ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a2b7e2a-1c2d-4ebb-8743-e53dc8127e99', 'enforce_multipath': True} {{(pid=88119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 10 00:24:46 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-3afa49f6-eebb-43c0-8854-eff54d0f4709 req-b291e650-f77b-44b0-99b0-43fd3d0bbd98 tempest-TaggedAttachmentsTest-259487641 None] attachment_update completed successfully. Jul 10 00:24:47 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:24:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Flow 'volume_create_manager' (f512efa2-971b-4cfc-9e97-85ded55f54bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:24:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f4d658-d05b-449f-be31-c16b1b007368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:24:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f4d658-d05b-449f-be31-c16b1b007368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1852811026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d41e3d39-a5c1-4e30-a41e-5d04423f6b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd12128eca2e4c2dbb9b25173edbb4c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:24:48Z,use_quota=True,user_id='cbb912c27e90494296bb1dce623c0613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:24:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0afa047d-e666-43ac-9222-9dc8d58b755e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:24:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0afa047d-e666-43ac-9222-9dc8d58b755e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:24:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c9a843-8c6d-4306-ae0b-c402d11044d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:24:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8c9a843-8c6d-4306-ae0b-c402d11044d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd41e3d39-a5c1-4e30-a41e-5d04423f6b21', 'volume_name': 'volume-d41e3d39-a5c1-4e30-a41e-5d04423f6b21', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:24:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e6ee58-909a-4270-beab-3f9c4a37a939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:24:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e6ee58-909a-4270-beab-3f9c4a37a939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:24:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517e4e1b-2975-4b98-aba8-9c827bbf7d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:24:48 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Volume d41e3d39-a5c1-4e30-a41e-5d04423f6b21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d41e3d39-a5c1-4e30-a41e-5d04423f6b21', 'volume_size': 1} Jul 10 00:24:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:24:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:24:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1852811026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d41e3d39-a5c1-4e30-a41e-5d04423f6b21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd12128eca2e4c2dbb9b25173edbb4c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:24:48Z,use_quota=True,user_id='cbb912c27e90494296bb1dce623c0613',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:24:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Creating volume d41e3d39-a5c1-4e30-a41e-5d04423f6b21 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:24:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:24:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:24:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:24:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:24:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:24:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:24:48 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:24:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d41e3d39-a5c1-4e30-a41e-5d04423f6b21 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:48 devstack sudo[90188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d41e3d39-a5c1-4e30-a41e-5d04423f6b21 1073741824 Jul 10 00:24:48 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:49 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d41e3d39-a5c1-4e30-a41e-5d04423f6b21 1073741824" returned: 0 in 1.011s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d41e3d39-a5c1-4e30-a41e-5d04423f6b21 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:24:49 devstack sudo[90202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d41e3d39-a5c1-4e30-a41e-5d04423f6b21 Jul 10 00:24:49 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:24:49 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root Jul 10 00:24:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d41e3d39-a5c1-4e30-a41e-5d04423f6b21" returned: 0 in 0.859s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:24:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] <== create_volume: return (1925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:24:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.928s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:24:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517e4e1b-2975-4b98-aba8-9c827bbf7d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d41e3d39-a5c1-4e30-a41e-5d04423f6b21', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:24:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19ed491-aac4-44a9-9d1f-ad8c8ca61d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:24:50 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Volume volume-d41e3d39-a5c1-4e30-a41e-5d04423f6b21 (d41e3d39-a5c1-4e30-a41e-5d04423f6b21): created successfully Jul 10 00:24:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19ed491-aac4-44a9-9d1f-ad8c8ca61d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:24:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Flow 'volume_create_manager' (f512efa2-971b-4cfc-9e97-85ded55f54bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:24:50 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-d296888b-c920-44e2-9ad8-7ca7eb32bc6f tempest-ServerActionsTestOtherA-917121098 None] Created volume successfully. Jul 10 00:24:55 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-276f738a-1a8d-4000-809f-97994e75bedb req-e8fe0d0a-9612-41ff-aac5-d81ae2f85d27 tempest-TaggedAttachmentsTest-259487641 None] Terminate volume connection completed successfully. Jul 10 00:24:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-276f738a-1a8d-4000-809f-97994e75bedb req-e8fe0d0a-9612-41ff-aac5-d81ae2f85d27 tempest-TaggedAttachmentsTest-259487641 None] Deleting attachment 6a2b7e2a-1c2d-4ebb-8743-e53dc8127e99. {{(pid=88119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 10 00:25:00 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=7,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:25:03 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:25:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Flow 'volume_create_manager' (ad77ed41-f1ae-4c70-bd6a-dea8a40e586b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:25:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e81e5a-4041-428c-8a64-2d15d4e8a193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:25:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e81e5a-4041-428c-8a64-2d15d4e8a193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1988798088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a53340-0e52-4546-a404-c9fd90de330e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d6e3ccb44c49bc9bcf2cf389328f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:25:03Z,use_quota=True,user_id='93c4697f114b413c8ac35e01f0b9b21a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:25:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14e8e3df-a792-4db8-a94a-b4fd35daa42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:25:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14e8e3df-a792-4db8-a94a-b4fd35daa42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:25:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6031436-4dc3-4161-b21c-b9cc0c1679ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:25:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6031436-4dc3-4161-b21c-b9cc0c1679ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99a53340-0e52-4546-a404-c9fd90de330e', 'volume_name': 'volume-99a53340-0e52-4546-a404-c9fd90de330e', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:25:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6778c6-3033-4833-ada0-0cf2c43355c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:25:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6778c6-3033-4833-ada0-0cf2c43355c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:25:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e763e02a-93de-45aa-b6c1-7230c9ba7a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:25:03 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Volume 99a53340-0e52-4546-a404-c9fd90de330e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99a53340-0e52-4546-a404-c9fd90de330e', 'volume_size': 1} Jul 10 00:25:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:25:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:25:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1988798088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a53340-0e52-4546-a404-c9fd90de330e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d6e3ccb44c49bc9bcf2cf389328f41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:25:03Z,use_quota=True,user_id='93c4697f114b413c8ac35e01f0b9b21a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:25:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Creating volume 99a53340-0e52-4546-a404-c9fd90de330e {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:25:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:25:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:25:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:25:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:25:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:25:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:25:03 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:25:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-99a53340-0e52-4546-a404-c9fd90de330e 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:25:03 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-99a53340-0e52-4546-a404-c9fd90de330e 1073741824 Jul 10 00:25:03 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:25:05 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Jul 10 00:25:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-99a53340-0e52-4546-a404-c9fd90de330e 1073741824" returned: 0 in 1.675s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:25:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-99a53340-0e52-4546-a404-c9fd90de330e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:25:05 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-99a53340-0e52-4546-a404-c9fd90de330e Jul 10 00:25:05 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:25:06 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Jul 10 00:25:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-99a53340-0e52-4546-a404-c9fd90de330e" returned: 0 in 0.906s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:25:06 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] <== create_volume: return (2735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:25:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.739s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:25:06 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e763e02a-93de-45aa-b6c1-7230c9ba7a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99a53340-0e52-4546-a404-c9fd90de330e', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:25:06 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ddea3c1-510b-4aed-82e2-dff368b597fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:25:06 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Volume volume-99a53340-0e52-4546-a404-c9fd90de330e (99a53340-0e52-4546-a404-c9fd90de330e): created successfully Jul 10 00:25:06 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ddea3c1-510b-4aed-82e2-dff368b597fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:25:06 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Flow 'volume_create_manager' (ad77ed41-f1ae-4c70-bd6a-dea8a40e586b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:25:06 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-04d97664-f8a1-4333-9917-00b2cccc4853 tempest-DeleteServersTestJSON-637801873 None] Created volume successfully. Jul 10 00:25:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-1d1b0fb0-2406-4bf8-9890-caa9e9f5cf01 req-2764c6b0-a4d5-4b0c-95f5-19f9102a6400 tempest-DeleteServersTestJSON-637801873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:25:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-1d1b0fb0-2406-4bf8-9890-caa9e9f5cf01 req-2764c6b0-a4d5-4b0c-95f5-19f9102a6400 tempest-DeleteServersTestJSON-637801873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:25:10 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbc2a17-2ef6-4ecb-82f2-734ec1a9e707]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:25:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-1d1b0fb0-2406-4bf8-9890-caa9e9f5cf01 req-2764c6b0-a4d5-4b0c-95f5-19f9102a6400 tempest-DeleteServersTestJSON-637801873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-99a53340-0e52-4546-a404-c9fd90de330e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:25:10 devstack sudo[91172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-99a53340-0e52-4546-a404-c9fd90de330e Jul 10 00:25:10 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:25:12 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root Jul 10 00:25:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-1d1b0fb0-2406-4bf8-9890-caa9e9f5cf01 req-2764c6b0-a4d5-4b0c-95f5-19f9102a6400 tempest-DeleteServersTestJSON-637801873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-99a53340-0e52-4546-a404-c9fd90de330e" returned: 0 in 2.089s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:25:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-1d1b0fb0-2406-4bf8-9890-caa9e9f5cf01 req-2764c6b0-a4d5-4b0c-95f5-19f9102a6400 tempest-DeleteServersTestJSON-637801873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.159s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:25:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-1d1b0fb0-2406-4bf8-9890-caa9e9f5cf01 req-2764c6b0-a4d5-4b0c-95f5-19f9102a6400 tempest-DeleteServersTestJSON-637801873 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff', 'name': 'volume-99a53340-0e52-4546-a404-c9fd90de330e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a06d7f25-37f0-4fe9-8f0a-52666e5512c0', 'enforce_multipath': True} {{(pid=88119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 10 00:25:12 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-1d1b0fb0-2406-4bf8-9890-caa9e9f5cf01 req-2764c6b0-a4d5-4b0c-95f5-19f9102a6400 tempest-DeleteServersTestJSON-637801873 None] attachment_update completed successfully. Jul 10 00:25:22 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:UPDATE=6,cinder:SELECT=6,cinder:INSERT=1 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:25:22 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=19,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:25:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-703ef3d4-ed4f-4f40-8cc3-81d2253ee2c1 tempest-TaggedAttachmentsTest-259487641 None] Acquiring lock "cinder-ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:25:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-703ef3d4-ed4f-4f40-8cc3-81d2253ee2c1 tempest-TaggedAttachmentsTest-259487641 None] Lock "cinder-ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:25:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-703ef3d4-ed4f-4f40-8cc3-81d2253ee2c1 tempest-TaggedAttachmentsTest-259487641 None] Acquiring lock "cinder-quobyte-ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:25:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-703ef3d4-ed4f-4f40-8cc3-81d2253ee2c1 tempest-TaggedAttachmentsTest-259487641 None] Lock "cinder-quobyte-ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb" acquired by "delete_volume" :: waited 0.028s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:25:24 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[506b5401-1373-4811-b78a-191454c91d5a]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:25:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-703ef3d4-ed4f-4f40-8cc3-81d2253ee2c1 tempest-TaggedAttachmentsTest-259487641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:25:25 devstack sudo[91729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb Jul 10 00:25:25 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:25:25 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-9422dd95-96e1-4802-a322-0af66beb9a27 req-23630a3b-7a1e-4b45-b298-18afd1707416 tempest-DeleteServersTestJSON-637801873 None] Terminate volume connection completed successfully. Jul 10 00:25:25 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-9422dd95-96e1-4802-a322-0af66beb9a27 req-23630a3b-7a1e-4b45-b298-18afd1707416 tempest-DeleteServersTestJSON-637801873 None] Deleting attachment a06d7f25-37f0-4fe9-8f0a-52666e5512c0. {{(pid=88119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 10 00:25:26 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root Jul 10 00:25:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-703ef3d4-ed4f-4f40-8cc3-81d2253ee2c1 tempest-TaggedAttachmentsTest-259487641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb" returned: 0 in 1.654s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:25:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-703ef3d4-ed4f-4f40-8cc3-81d2253ee2c1 tempest-TaggedAttachmentsTest-259487641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:25:26 devstack sudo[91795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb Jul 10 00:25:26 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:25:27 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root Jul 10 00:25:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-703ef3d4-ed4f-4f40-8cc3-81d2253ee2c1 tempest-TaggedAttachmentsTest-259487641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb" returned: 0 in 1.040s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:25:27 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-703ef3d4-ed4f-4f40-8cc3-81d2253ee2c1 tempest-TaggedAttachmentsTest-259487641 None] Lock "cinder-quobyte-ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb" released by "delete_volume" :: held 2.781s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:25:27 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-703ef3d4-ed4f-4f40-8cc3-81d2253ee2c1 tempest-TaggedAttachmentsTest-259487641 None] Created reservations ['55ca5327-9bed-4fab-b419-8653eed60260', 'f7c1c7ca-6d01-4c25-81be-d354d66b2204', '341ff4fd-4c41-4290-9f40-42d21a74fb54', 'bbaa0397-45ec-4946-be5c-139d28a01d79'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:25:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-703ef3d4-ed4f-4f40-8cc3-81d2253ee2c1 tempest-TaggedAttachmentsTest-259487641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:25:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-703ef3d4-ed4f-4f40-8cc3-81d2253ee2c1 tempest-TaggedAttachmentsTest-259487641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:25:27 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-703ef3d4-ed4f-4f40-8cc3-81d2253ee2c1 tempest-TaggedAttachmentsTest-259487641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:25:27 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-703ef3d4-ed4f-4f40-8cc3-81d2253ee2c1 tempest-TaggedAttachmentsTest-259487641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:25:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-703ef3d4-ed4f-4f40-8cc3-81d2253ee2c1 tempest-TaggedAttachmentsTest-259487641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:25:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-703ef3d4-ed4f-4f40-8cc3-81d2253ee2c1 tempest-TaggedAttachmentsTest-259487641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:25:27 devstack sudo[91809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:25:27 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:25:28 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root Jul 10 00:25:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-703ef3d4-ed4f-4f40-8cc3-81d2253ee2c1 tempest-TaggedAttachmentsTest-259487641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.747s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:25:28 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-703ef3d4-ed4f-4f40-8cc3-81d2253ee2c1 tempest-TaggedAttachmentsTest-259487641 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:25:28 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-703ef3d4-ed4f-4f40-8cc3-81d2253ee2c1 tempest-TaggedAttachmentsTest-259487641 None] Deleted volume successfully. Jul 10 00:25:28 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-703ef3d4-ed4f-4f40-8cc3-81d2253ee2c1 tempest-TaggedAttachmentsTest-259487641 None] Lock "cinder-ddd8a96e-5cd8-4ab6-a32c-6ad00e7fdbdb-delete_volume" released by "delete_volume" :: held 3.806s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:25:29 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d425bacc-6cf7-4098-b2e1-a38c8741bac1 tempest-DeleteServersTestJSON-637801873 None] Acquiring lock "cinder-99a53340-0e52-4546-a404-c9fd90de330e-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:25:29 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d425bacc-6cf7-4098-b2e1-a38c8741bac1 tempest-DeleteServersTestJSON-637801873 None] Lock "cinder-99a53340-0e52-4546-a404-c9fd90de330e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:25:29 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d425bacc-6cf7-4098-b2e1-a38c8741bac1 tempest-DeleteServersTestJSON-637801873 None] Acquiring lock "cinder-quobyte-99a53340-0e52-4546-a404-c9fd90de330e" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:25:29 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d425bacc-6cf7-4098-b2e1-a38c8741bac1 tempest-DeleteServersTestJSON-637801873 None] Lock "cinder-quobyte-99a53340-0e52-4546-a404-c9fd90de330e" acquired by "delete_volume" :: waited 0.023s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:25:29 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2238ac4-d9e2-41ed-b87c-b8deaa7ca771]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:25:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d425bacc-6cf7-4098-b2e1-a38c8741bac1 tempest-DeleteServersTestJSON-637801873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-99a53340-0e52-4546-a404-c9fd90de330e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:25:29 devstack sudo[91812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-99a53340-0e52-4546-a404-c9fd90de330e Jul 10 00:25:29 devstack sudo[91812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:25:30 devstack sudo[91812]: pam_unix(sudo:session): session closed for user root Jul 10 00:25:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d425bacc-6cf7-4098-b2e1-a38c8741bac1 tempest-DeleteServersTestJSON-637801873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-99a53340-0e52-4546-a404-c9fd90de330e" returned: 0 in 1.211s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:25:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d425bacc-6cf7-4098-b2e1-a38c8741bac1 tempest-DeleteServersTestJSON-637801873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-99a53340-0e52-4546-a404-c9fd90de330e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:25:30 devstack sudo[91867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-99a53340-0e52-4546-a404-c9fd90de330e Jul 10 00:25:30 devstack sudo[91867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:25:31 devstack sudo[91867]: pam_unix(sudo:session): session closed for user root Jul 10 00:25:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d425bacc-6cf7-4098-b2e1-a38c8741bac1 tempest-DeleteServersTestJSON-637801873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-99a53340-0e52-4546-a404-c9fd90de330e" returned: 0 in 0.653s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:25:31 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d425bacc-6cf7-4098-b2e1-a38c8741bac1 tempest-DeleteServersTestJSON-637801873 None] Lock "cinder-quobyte-99a53340-0e52-4546-a404-c9fd90de330e" released by "delete_volume" :: held 1.920s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:25:31 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-d425bacc-6cf7-4098-b2e1-a38c8741bac1 tempest-DeleteServersTestJSON-637801873 None] Created reservations ['c2d85cf9-cce9-4538-bff4-6b8cb1cc8125', '23f2391a-65f5-490f-ac17-c0dc776af391', 'cc00ff97-494e-491f-b6e6-42302f471ef6', 'be5dfe7b-8e25-4e8c-ad26-8ec5a8b18d79'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:25:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d425bacc-6cf7-4098-b2e1-a38c8741bac1 tempest-DeleteServersTestJSON-637801873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:25:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d425bacc-6cf7-4098-b2e1-a38c8741bac1 tempest-DeleteServersTestJSON-637801873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:25:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d425bacc-6cf7-4098-b2e1-a38c8741bac1 tempest-DeleteServersTestJSON-637801873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:25:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d425bacc-6cf7-4098-b2e1-a38c8741bac1 tempest-DeleteServersTestJSON-637801873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:25:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d425bacc-6cf7-4098-b2e1-a38c8741bac1 tempest-DeleteServersTestJSON-637801873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:25:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d425bacc-6cf7-4098-b2e1-a38c8741bac1 tempest-DeleteServersTestJSON-637801873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:25:31 devstack sudo[91871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:25:31 devstack sudo[91871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:25:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:25:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:25:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:25:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:25:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:25:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:25:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:25:31 devstack sudo[91877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:25:31 devstack sudo[91877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:25:32 devstack sudo[91871]: pam_unix(sudo:session): session closed for user root Jul 10 00:25:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d425bacc-6cf7-4098-b2e1-a38c8741bac1 tempest-DeleteServersTestJSON-637801873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.821s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:25:32 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-d425bacc-6cf7-4098-b2e1-a38c8741bac1 tempest-DeleteServersTestJSON-637801873 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:25:32 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-d425bacc-6cf7-4098-b2e1-a38c8741bac1 tempest-DeleteServersTestJSON-637801873 None] Deleted volume successfully. Jul 10 00:25:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d425bacc-6cf7-4098-b2e1-a38c8741bac1 tempest-DeleteServersTestJSON-637801873 None] Lock "cinder-99a53340-0e52-4546-a404-c9fd90de330e-delete_volume" released by "delete_volume" :: held 2.999s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:25:32 devstack sudo[91877]: pam_unix(sudo:session): session closed for user root Jul 10 00:25:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.088s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:25:32 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:25:32 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:25:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 8 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:25:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:25:41 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:UPDATE=18,cinder:SELECT=13,cinder:INSERT=4 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:25:42 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=9,cinder:INSERT=4,cinder:UPDATE=14,cinder:DELETE=2 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:25:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-64af09d8-5611-40bb-939c-4433bc391eec req-6501a063-1bdc-4b02-a50a-74a8d7502396 tempest-ServerActionsTestOtherA-917121098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:25:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-64af09d8-5611-40bb-939c-4433bc391eec req-6501a063-1bdc-4b02-a50a-74a8d7502396 tempest-ServerActionsTestOtherA-917121098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:25:44 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[3067190f-80f3-434c-a3c9-5457e225d6cf]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:25:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-64af09d8-5611-40bb-939c-4433bc391eec req-6501a063-1bdc-4b02-a50a-74a8d7502396 tempest-ServerActionsTestOtherA-917121098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d41e3d39-a5c1-4e30-a41e-5d04423f6b21 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:25:44 devstack sudo[91967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d41e3d39-a5c1-4e30-a41e-5d04423f6b21 Jul 10 00:25:44 devstack sudo[91967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:25:45 devstack sudo[91967]: pam_unix(sudo:session): session closed for user root Jul 10 00:25:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-64af09d8-5611-40bb-939c-4433bc391eec req-6501a063-1bdc-4b02-a50a-74a8d7502396 tempest-ServerActionsTestOtherA-917121098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d41e3d39-a5c1-4e30-a41e-5d04423f6b21" returned: 0 in 0.929s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:25:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-64af09d8-5611-40bb-939c-4433bc391eec req-6501a063-1bdc-4b02-a50a-74a8d7502396 tempest-ServerActionsTestOtherA-917121098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.957s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:25:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-64af09d8-5611-40bb-939c-4433bc391eec req-6501a063-1bdc-4b02-a50a-74a8d7502396 tempest-ServerActionsTestOtherA-917121098 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff', 'name': 'volume-d41e3d39-a5c1-4e30-a41e-5d04423f6b21', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '747dbc91-6661-4a94-9e93-9b77305a5f3f', 'enforce_multipath': True} {{(pid=88119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 10 00:25:45 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-64af09d8-5611-40bb-939c-4433bc391eec req-6501a063-1bdc-4b02-a50a-74a8d7502396 tempest-ServerActionsTestOtherA-917121098 None] attachment_update completed successfully. Jul 10 00:25:47 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:25:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Flow 'volume_create_manager' (77679950-8a56-4e22-a6a0-a9a561b17112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:25:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ab2ca6-ccb8-4aeb-a778-3c5c0bd0f0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:25:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28ab2ca6-ccb8-4aeb-a778-3c5c0bd0f0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-181830202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30fa221f-9c5a-4c94-8c13-0b8c1b577082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d412d1ce8d4d46dba103eb708852da07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:25:47Z,use_quota=True,user_id='db2bd8ef6c1740409acb3db935d4049b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:25:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f070d80-691b-4795-aefa-4d48725a9cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:25:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f070d80-691b-4795-aefa-4d48725a9cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:25:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43642672-4177-4eea-bc03-c7005a67c39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:25:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43642672-4177-4eea-bc03-c7005a67c39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30fa221f-9c5a-4c94-8c13-0b8c1b577082', 'volume_name': 'volume-30fa221f-9c5a-4c94-8c13-0b8c1b577082', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:25:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60501cdc-59c9-4725-aaf0-26ef5fbd6cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:25:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60501cdc-59c9-4725-aaf0-26ef5fbd6cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:25:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2df61a1-67d0-4752-80ef-43f9d6679c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:25:47 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Volume 30fa221f-9c5a-4c94-8c13-0b8c1b577082: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30fa221f-9c5a-4c94-8c13-0b8c1b577082', 'volume_size': 1} Jul 10 00:25:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:25:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:25:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-181830202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30fa221f-9c5a-4c94-8c13-0b8c1b577082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d412d1ce8d4d46dba103eb708852da07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:25:47Z,use_quota=True,user_id='db2bd8ef6c1740409acb3db935d4049b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:25:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Creating volume 30fa221f-9c5a-4c94-8c13-0b8c1b577082 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:25:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:25:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:25:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:25:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:25:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:25:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:25:47 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:25:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-30fa221f-9c5a-4c94-8c13-0b8c1b577082 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:25:47 devstack sudo[92355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-30fa221f-9c5a-4c94-8c13-0b8c1b577082 1073741824 Jul 10 00:25:47 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:25:48 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root Jul 10 00:25:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-30fa221f-9c5a-4c94-8c13-0b8c1b577082 1073741824" returned: 0 in 0.956s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:25:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-30fa221f-9c5a-4c94-8c13-0b8c1b577082 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:25:48 devstack sudo[92361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-30fa221f-9c5a-4c94-8c13-0b8c1b577082 Jul 10 00:25:48 devstack sudo[92361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:25:49 devstack sudo[92361]: pam_unix(sudo:session): session closed for user root Jul 10 00:25:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-30fa221f-9c5a-4c94-8c13-0b8c1b577082" returned: 0 in 0.721s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:25:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:25:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:25:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2df61a1-67d0-4752-80ef-43f9d6679c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30fa221f-9c5a-4c94-8c13-0b8c1b577082', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:25:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c044fe6-70ee-4023-a685-55ae4215445b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:25:49 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Volume volume-30fa221f-9c5a-4c94-8c13-0b8c1b577082 (30fa221f-9c5a-4c94-8c13-0b8c1b577082): created successfully Jul 10 00:25:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c044fe6-70ee-4023-a685-55ae4215445b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:25:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Flow 'volume_create_manager' (77679950-8a56-4e22-a6a0-a9a561b17112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:25:49 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-40f63e34-c4b6-4bcd-94ef-a8d7b34ef798 tempest-ServersNegativeTestJSON-872587697 None] Created volume successfully. Jul 10 00:25:52 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:25:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Flow 'volume_create_manager' (a991a28e-54d7-46d0-8c14-6ca431cd3bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:25:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f5236b-5880-4545-8501-82834d4c8bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:25:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f5236b-5880-4545-8501-82834d4c8bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1988669078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9167b699-bbec-4138-a4f0-7d3f2f1d0597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d412d1ce8d4d46dba103eb708852da07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:25:52Z,use_quota=True,user_id='db2bd8ef6c1740409acb3db935d4049b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:25:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae9efee-6d76-4a49-9e49-220be2bbc8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:25:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae9efee-6d76-4a49-9e49-220be2bbc8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:25:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89051bc7-d254-4fe5-ba1a-a7423a31227a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:25:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89051bc7-d254-4fe5-ba1a-a7423a31227a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9167b699-bbec-4138-a4f0-7d3f2f1d0597', 'volume_name': 'volume-9167b699-bbec-4138-a4f0-7d3f2f1d0597', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:25:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51390495-8541-4b3a-b2f0-8489badeca96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:25:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51390495-8541-4b3a-b2f0-8489badeca96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:25:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a0a500-dca7-40e3-970e-07276ae91f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:25:52 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Volume 9167b699-bbec-4138-a4f0-7d3f2f1d0597: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9167b699-bbec-4138-a4f0-7d3f2f1d0597', 'volume_size': 1} Jul 10 00:25:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:25:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:25:52 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1988669078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9167b699-bbec-4138-a4f0-7d3f2f1d0597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d412d1ce8d4d46dba103eb708852da07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:25:52Z,use_quota=True,user_id='db2bd8ef6c1740409acb3db935d4049b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:25:52 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Creating volume 9167b699-bbec-4138-a4f0-7d3f2f1d0597 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:25:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:25:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:25:52 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:25:52 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:25:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:25:52 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:25:52 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:25:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9167b699-bbec-4138-a4f0-7d3f2f1d0597 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:25:52 devstack sudo[92373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9167b699-bbec-4138-a4f0-7d3f2f1d0597 1073741824 Jul 10 00:25:52 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:25:53 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root Jul 10 00:25:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9167b699-bbec-4138-a4f0-7d3f2f1d0597 1073741824" returned: 0 in 1.013s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:25:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9167b699-bbec-4138-a4f0-7d3f2f1d0597 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:25:53 devstack sudo[92379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9167b699-bbec-4138-a4f0-7d3f2f1d0597 Jul 10 00:25:53 devstack sudo[92379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:25:54 devstack sudo[92379]: pam_unix(sudo:session): session closed for user root Jul 10 00:25:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9167b699-bbec-4138-a4f0-7d3f2f1d0597" returned: 0 in 0.841s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:25:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] <== create_volume: return (1924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:25:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.928s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:25:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a0a500-dca7-40e3-970e-07276ae91f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9167b699-bbec-4138-a4f0-7d3f2f1d0597', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:25:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc7447f-2157-4fc1-a387-1e243afb0a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:25:54 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Volume volume-9167b699-bbec-4138-a4f0-7d3f2f1d0597 (9167b699-bbec-4138-a4f0-7d3f2f1d0597): created successfully Jul 10 00:25:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc7447f-2157-4fc1-a387-1e243afb0a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:25:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Flow 'volume_create_manager' (a991a28e-54d7-46d0-8c14-6ca431cd3bfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:25:54 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-5c9cba94-f1f5-4cd0-bfe6-fbdb23829a7a tempest-ServersNegativeTestJSON-872587697 None] Created volume successfully. Jul 10 00:25:54 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-f44de63d-6634-4001-9600-cd50780f7a00 req-cd2007cc-b8db-40e6-8a83-199ecab930f0 tempest-ServerActionsTestOtherA-917121098 None] Terminate volume connection completed successfully. Jul 10 00:25:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-f44de63d-6634-4001-9600-cd50780f7a00 req-cd2007cc-b8db-40e6-8a83-199ecab930f0 tempest-ServerActionsTestOtherA-917121098 None] Deleting attachment 747dbc91-6661-4a94-9e93-9b77305a5f3f. {{(pid=88119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 10 00:25:57 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-048052f7-2603-45e5-88c6-7396eff79066 tempest-ServersNegativeTestJSON-872587697 None] Acquiring lock "cinder-9167b699-bbec-4138-a4f0-7d3f2f1d0597-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:25:57 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-048052f7-2603-45e5-88c6-7396eff79066 tempest-ServersNegativeTestJSON-872587697 None] Lock "cinder-9167b699-bbec-4138-a4f0-7d3f2f1d0597-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:25:57 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-048052f7-2603-45e5-88c6-7396eff79066 tempest-ServersNegativeTestJSON-872587697 None] Acquiring lock "cinder-quobyte-9167b699-bbec-4138-a4f0-7d3f2f1d0597" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:25:57 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-048052f7-2603-45e5-88c6-7396eff79066 tempest-ServersNegativeTestJSON-872587697 None] Lock "cinder-quobyte-9167b699-bbec-4138-a4f0-7d3f2f1d0597" acquired by "delete_volume" :: waited 0.042s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:25:57 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c5e7d5-4f58-4c9e-821e-5147aaf0f8c1]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:25:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-048052f7-2603-45e5-88c6-7396eff79066 tempest-ServersNegativeTestJSON-872587697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9167b699-bbec-4138-a4f0-7d3f2f1d0597 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:25:57 devstack sudo[92441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9167b699-bbec-4138-a4f0-7d3f2f1d0597 Jul 10 00:25:57 devstack sudo[92441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:25:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-f44de63d-6634-4001-9600-cd50780f7a00 req-12614378-9526-4dc6-af11-59a1272b577c tempest-ServerActionsTestOtherA-917121098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:25:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-f44de63d-6634-4001-9600-cd50780f7a00 req-12614378-9526-4dc6-af11-59a1272b577c tempest-ServerActionsTestOtherA-917121098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:25:57 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[28503b1f-2504-4951-a303-7ac042a97682]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:25:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-f44de63d-6634-4001-9600-cd50780f7a00 req-12614378-9526-4dc6-af11-59a1272b577c tempest-ServerActionsTestOtherA-917121098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d41e3d39-a5c1-4e30-a41e-5d04423f6b21 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:25:57 devstack sudo[92443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d41e3d39-a5c1-4e30-a41e-5d04423f6b21 Jul 10 00:25:57 devstack sudo[92443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:25:58 devstack sudo[92441]: pam_unix(sudo:session): session closed for user root Jul 10 00:25:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-048052f7-2603-45e5-88c6-7396eff79066 tempest-ServersNegativeTestJSON-872587697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9167b699-bbec-4138-a4f0-7d3f2f1d0597" returned: 0 in 1.326s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:25:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-048052f7-2603-45e5-88c6-7396eff79066 tempest-ServersNegativeTestJSON-872587697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9167b699-bbec-4138-a4f0-7d3f2f1d0597 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:25:58 devstack sudo[92455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9167b699-bbec-4138-a4f0-7d3f2f1d0597 Jul 10 00:25:58 devstack sudo[92455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:25:59 devstack sudo[92443]: pam_unix(sudo:session): session closed for user root Jul 10 00:25:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-f44de63d-6634-4001-9600-cd50780f7a00 req-12614378-9526-4dc6-af11-59a1272b577c tempest-ServerActionsTestOtherA-917121098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d41e3d39-a5c1-4e30-a41e-5d04423f6b21" returned: 0 in 1.296s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:25:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-f44de63d-6634-4001-9600-cd50780f7a00 req-12614378-9526-4dc6-af11-59a1272b577c tempest-ServerActionsTestOtherA-917121098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.328s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:25:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-f44de63d-6634-4001-9600-cd50780f7a00 req-12614378-9526-4dc6-af11-59a1272b577c tempest-ServerActionsTestOtherA-917121098 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff', 'name': 'volume-d41e3d39-a5c1-4e30-a41e-5d04423f6b21', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61c982d9-3295-4cbb-96f9-c87a20a7d949', 'enforce_multipath': True} {{(pid=88119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 10 00:25:59 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-f44de63d-6634-4001-9600-cd50780f7a00 req-12614378-9526-4dc6-af11-59a1272b577c tempest-ServerActionsTestOtherA-917121098 None] attachment_update completed successfully. Jul 10 00:25:59 devstack sudo[92455]: pam_unix(sudo:session): session closed for user root Jul 10 00:25:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-048052f7-2603-45e5-88c6-7396eff79066 tempest-ServersNegativeTestJSON-872587697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9167b699-bbec-4138-a4f0-7d3f2f1d0597" returned: 0 in 0.847s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:25:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-048052f7-2603-45e5-88c6-7396eff79066 tempest-ServersNegativeTestJSON-872587697 None] Lock "cinder-quobyte-9167b699-bbec-4138-a4f0-7d3f2f1d0597" released by "delete_volume" :: held 2.223s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:25:59 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-048052f7-2603-45e5-88c6-7396eff79066 tempest-ServersNegativeTestJSON-872587697 None] Created reservations ['ae5b68ac-a4a1-4bfe-9440-15a4152de3d7', 'ac2d1d2d-9ae3-4dd3-85a6-69abe9150bbf', '60611334-1971-4360-be3c-8981caeca770', '5b034b72-c95c-4d11-a048-148bfb1166fd'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:25:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-048052f7-2603-45e5-88c6-7396eff79066 tempest-ServersNegativeTestJSON-872587697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:25:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-048052f7-2603-45e5-88c6-7396eff79066 tempest-ServersNegativeTestJSON-872587697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:25:59 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-048052f7-2603-45e5-88c6-7396eff79066 tempest-ServersNegativeTestJSON-872587697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:25:59 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-048052f7-2603-45e5-88c6-7396eff79066 tempest-ServersNegativeTestJSON-872587697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:25:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-048052f7-2603-45e5-88c6-7396eff79066 tempest-ServersNegativeTestJSON-872587697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:25:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-048052f7-2603-45e5-88c6-7396eff79066 tempest-ServersNegativeTestJSON-872587697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:25:59 devstack sudo[92461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:25:59 devstack sudo[92461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:00 devstack sudo[92461]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-048052f7-2603-45e5-88c6-7396eff79066 tempest-ServersNegativeTestJSON-872587697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.763s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:00 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-048052f7-2603-45e5-88c6-7396eff79066 tempest-ServersNegativeTestJSON-872587697 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:26:00 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-048052f7-2603-45e5-88c6-7396eff79066 tempest-ServersNegativeTestJSON-872587697 None] Deleted volume successfully. Jul 10 00:26:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-048052f7-2603-45e5-88c6-7396eff79066 tempest-ServersNegativeTestJSON-872587697 None] Lock "cinder-9167b699-bbec-4138-a4f0-7d3f2f1d0597-delete_volume" released by "delete_volume" :: held 3.304s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:26:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-58226fe5-7986-4d62-82eb-9e053706b673 tempest-ServersNegativeTestJSON-872587697 None] Acquiring lock "cinder-30fa221f-9c5a-4c94-8c13-0b8c1b577082-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:26:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-58226fe5-7986-4d62-82eb-9e053706b673 tempest-ServersNegativeTestJSON-872587697 None] Lock "cinder-30fa221f-9c5a-4c94-8c13-0b8c1b577082-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:26:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-58226fe5-7986-4d62-82eb-9e053706b673 tempest-ServersNegativeTestJSON-872587697 None] Acquiring lock "cinder-quobyte-30fa221f-9c5a-4c94-8c13-0b8c1b577082" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:26:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-58226fe5-7986-4d62-82eb-9e053706b673 tempest-ServersNegativeTestJSON-872587697 None] Lock "cinder-quobyte-30fa221f-9c5a-4c94-8c13-0b8c1b577082" acquired by "delete_volume" :: waited 0.017s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:26:00 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedf0705-7653-4f3b-9b8c-5ead0390ffb8]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:26:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-58226fe5-7986-4d62-82eb-9e053706b673 tempest-ServersNegativeTestJSON-872587697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-30fa221f-9c5a-4c94-8c13-0b8c1b577082 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:01 devstack sudo[92467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-30fa221f-9c5a-4c94-8c13-0b8c1b577082 Jul 10 00:26:01 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:01 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-58226fe5-7986-4d62-82eb-9e053706b673 tempest-ServersNegativeTestJSON-872587697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-30fa221f-9c5a-4c94-8c13-0b8c1b577082" returned: 0 in 0.931s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-58226fe5-7986-4d62-82eb-9e053706b673 tempest-ServersNegativeTestJSON-872587697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-30fa221f-9c5a-4c94-8c13-0b8c1b577082 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:01 devstack sudo[92492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-30fa221f-9c5a-4c94-8c13-0b8c1b577082 Jul 10 00:26:01 devstack sudo[92492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:02 devstack sudo[92492]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-58226fe5-7986-4d62-82eb-9e053706b673 tempest-ServersNegativeTestJSON-872587697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-30fa221f-9c5a-4c94-8c13-0b8c1b577082" returned: 0 in 0.689s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-58226fe5-7986-4d62-82eb-9e053706b673 tempest-ServersNegativeTestJSON-872587697 None] Lock "cinder-quobyte-30fa221f-9c5a-4c94-8c13-0b8c1b577082" released by "delete_volume" :: held 1.664s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:26:02 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-58226fe5-7986-4d62-82eb-9e053706b673 tempest-ServersNegativeTestJSON-872587697 None] Created reservations ['aa20c125-cd41-4b1a-89fd-2a0231bde7b0', '9b92a4d3-6e5c-46cd-859e-ac692b22246a', '501b27cd-50dd-4978-8e36-993e54337984', '9677e23d-7d65-496f-8f68-889c04025b72'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:26:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-58226fe5-7986-4d62-82eb-9e053706b673 tempest-ServersNegativeTestJSON-872587697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:26:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-58226fe5-7986-4d62-82eb-9e053706b673 tempest-ServersNegativeTestJSON-872587697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:26:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-58226fe5-7986-4d62-82eb-9e053706b673 tempest-ServersNegativeTestJSON-872587697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:26:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-58226fe5-7986-4d62-82eb-9e053706b673 tempest-ServersNegativeTestJSON-872587697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:26:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-58226fe5-7986-4d62-82eb-9e053706b673 tempest-ServersNegativeTestJSON-872587697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:26:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-58226fe5-7986-4d62-82eb-9e053706b673 tempest-ServersNegativeTestJSON-872587697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:02 devstack sudo[92563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:26:02 devstack sudo[92563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:03 devstack sudo[92563]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-58226fe5-7986-4d62-82eb-9e053706b673 tempest-ServersNegativeTestJSON-872587697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.841s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:03 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-58226fe5-7986-4d62-82eb-9e053706b673 tempest-ServersNegativeTestJSON-872587697 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:26:03 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-58226fe5-7986-4d62-82eb-9e053706b673 tempest-ServersNegativeTestJSON-872587697 None] Deleted volume successfully. Jul 10 00:26:03 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-58226fe5-7986-4d62-82eb-9e053706b673 tempest-ServersNegativeTestJSON-872587697 None] Lock "cinder-30fa221f-9c5a-4c94-8c13-0b8c1b577082-delete_volume" released by "delete_volume" :: held 2.731s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:26:16 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=26,cinder:UPDATE=24,cinder:DELETE=1,cinder:INSERT=3 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:26:16 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=27,cinder:UPDATE=27,cinder:INSERT=7,cinder:DELETE=3 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:26:24 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:26:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Flow 'volume_create_manager' (6f51cabe-d1bf-4bd4-95c8-3472ffd84807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:26:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49da2a01-5511-4be8-a561-96166adcc66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49da2a01-5511-4be8-a561-96166adcc66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1680437254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f913f951-7852-4813-990b-6790f533b2b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b69b6c978a9448a8ad3e73391cf3a3ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:26:25Z,use_quota=True,user_id='627c05cbca1441f183f60f7db10550b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce60a411-8310-4a2e-9943-35321574edec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce60a411-8310-4a2e-9943-35321574edec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c6f6c0-aa31-4549-aa08-2509b9122d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c6f6c0-aa31-4549-aa08-2509b9122d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f913f951-7852-4813-990b-6790f533b2b9', 'volume_name': 'volume-f913f951-7852-4813-990b-6790f533b2b9', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599a931a-742c-403c-b980-30b8ea71883a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599a931a-742c-403c-b980-30b8ea71883a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5c4a1f-54e6-4638-b575-33867dd5c2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:24 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Volume f913f951-7852-4813-990b-6790f533b2b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f913f951-7852-4813-990b-6790f533b2b9', 'volume_size': 1} Jul 10 00:26:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:26:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:26:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1680437254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f913f951-7852-4813-990b-6790f533b2b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b69b6c978a9448a8ad3e73391cf3a3ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:26:25Z,use_quota=True,user_id='627c05cbca1441f183f60f7db10550b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:26:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Creating volume f913f951-7852-4813-990b-6790f533b2b9 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:26:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:26:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:26:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:26:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:26:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:26:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:26:24 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:26:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f913f951-7852-4813-990b-6790f533b2b9 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:24 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f913f951-7852-4813-990b-6790f533b2b9 1073741824 Jul 10 00:26:24 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:25 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f913f951-7852-4813-990b-6790f533b2b9 1073741824" returned: 0 in 0.871s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f913f951-7852-4813-990b-6790f533b2b9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:25 devstack sudo[93225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f913f951-7852-4813-990b-6790f533b2b9 Jul 10 00:26:25 devstack sudo[93225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:26 devstack sudo[93225]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f913f951-7852-4813-990b-6790f533b2b9" returned: 0 in 0.685s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:26:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:26:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5c4a1f-54e6-4638-b575-33867dd5c2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f913f951-7852-4813-990b-6790f533b2b9', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901fb9c6-d26f-4bcf-ac86-ff8f103ee0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:26 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Volume volume-f913f951-7852-4813-990b-6790f533b2b9 (f913f951-7852-4813-990b-6790f533b2b9): created successfully Jul 10 00:26:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901fb9c6-d26f-4bcf-ac86-ff8f103ee0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Flow 'volume_create_manager' (6f51cabe-d1bf-4bd4-95c8-3472ffd84807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:26:26 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-b13eb9e0-aceb-423e-9a9e-119a8084af2a req-4b8e3467-de88-44b9-ac0f-d8ab9132788a tempest-VolumesGetTestJSON-837743747 None] Created volume successfully. Jul 10 00:26:27 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-b6a0ce6c-9c18-497f-93e3-95fef616791b req-24b94636-a61d-4bc1-a46c-5a402cb93f2b tempest-VolumesGetTestJSON-837743747 None] Acquiring lock "cinder-f913f951-7852-4813-990b-6790f533b2b9-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:26:27 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-b6a0ce6c-9c18-497f-93e3-95fef616791b req-24b94636-a61d-4bc1-a46c-5a402cb93f2b tempest-VolumesGetTestJSON-837743747 None] Lock "cinder-f913f951-7852-4813-990b-6790f533b2b9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:26:27 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-b6a0ce6c-9c18-497f-93e3-95fef616791b req-24b94636-a61d-4bc1-a46c-5a402cb93f2b tempest-VolumesGetTestJSON-837743747 None] Acquiring lock "cinder-quobyte-f913f951-7852-4813-990b-6790f533b2b9" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:26:27 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-b6a0ce6c-9c18-497f-93e3-95fef616791b req-24b94636-a61d-4bc1-a46c-5a402cb93f2b tempest-VolumesGetTestJSON-837743747 None] Lock "cinder-quobyte-f913f951-7852-4813-990b-6790f533b2b9" acquired by "delete_volume" :: waited 0.029s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:26:27 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7dd7a1-d2fb-4ec2-aecd-a18f51ff1941]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:26:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-b6a0ce6c-9c18-497f-93e3-95fef616791b req-24b94636-a61d-4bc1-a46c-5a402cb93f2b tempest-VolumesGetTestJSON-837743747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f913f951-7852-4813-990b-6790f533b2b9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:27 devstack sudo[93263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f913f951-7852-4813-990b-6790f533b2b9 Jul 10 00:26:27 devstack sudo[93263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:28 devstack sudo[93263]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-b6a0ce6c-9c18-497f-93e3-95fef616791b req-24b94636-a61d-4bc1-a46c-5a402cb93f2b tempest-VolumesGetTestJSON-837743747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f913f951-7852-4813-990b-6790f533b2b9" returned: 0 in 0.885s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-b6a0ce6c-9c18-497f-93e3-95fef616791b req-24b94636-a61d-4bc1-a46c-5a402cb93f2b tempest-VolumesGetTestJSON-837743747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f913f951-7852-4813-990b-6790f533b2b9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:28 devstack sudo[93272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f913f951-7852-4813-990b-6790f533b2b9 Jul 10 00:26:28 devstack sudo[93272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:28 devstack sudo[93272]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-b6a0ce6c-9c18-497f-93e3-95fef616791b req-24b94636-a61d-4bc1-a46c-5a402cb93f2b tempest-VolumesGetTestJSON-837743747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f913f951-7852-4813-990b-6790f533b2b9" returned: 0 in 0.784s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:28 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-b6a0ce6c-9c18-497f-93e3-95fef616791b req-24b94636-a61d-4bc1-a46c-5a402cb93f2b tempest-VolumesGetTestJSON-837743747 None] Lock "cinder-quobyte-f913f951-7852-4813-990b-6790f533b2b9" released by "delete_volume" :: held 1.726s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:26:28 devstack cinder-volume[88119]: DEBUG cinder.quota [req-b6a0ce6c-9c18-497f-93e3-95fef616791b req-24b94636-a61d-4bc1-a46c-5a402cb93f2b tempest-VolumesGetTestJSON-837743747 None] Created reservations ['58552e04-5456-4d1c-85e6-76f407b9af94', 'de51aa28-ac72-4ea9-b73f-d14409ea6c1d', '2cd2f9d2-a4a1-41bc-bdbd-84d6ea850e5a', '85a40a87-d00b-4d6d-a474-01338502d7f0'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:26:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-b6a0ce6c-9c18-497f-93e3-95fef616791b req-24b94636-a61d-4bc1-a46c-5a402cb93f2b tempest-VolumesGetTestJSON-837743747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:26:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-b6a0ce6c-9c18-497f-93e3-95fef616791b req-24b94636-a61d-4bc1-a46c-5a402cb93f2b tempest-VolumesGetTestJSON-837743747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:26:29 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [req-b6a0ce6c-9c18-497f-93e3-95fef616791b req-24b94636-a61d-4bc1-a46c-5a402cb93f2b tempest-VolumesGetTestJSON-837743747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:26:29 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [req-b6a0ce6c-9c18-497f-93e3-95fef616791b req-24b94636-a61d-4bc1-a46c-5a402cb93f2b tempest-VolumesGetTestJSON-837743747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:26:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-b6a0ce6c-9c18-497f-93e3-95fef616791b req-24b94636-a61d-4bc1-a46c-5a402cb93f2b tempest-VolumesGetTestJSON-837743747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:26:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-b6a0ce6c-9c18-497f-93e3-95fef616791b req-24b94636-a61d-4bc1-a46c-5a402cb93f2b tempest-VolumesGetTestJSON-837743747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:29 devstack sudo[93302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:26:29 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:29 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-b6a0ce6c-9c18-497f-93e3-95fef616791b req-24b94636-a61d-4bc1-a46c-5a402cb93f2b tempest-VolumesGetTestJSON-837743747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.694s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:29 devstack cinder-volume[88119]: DEBUG cinder.manager [req-b6a0ce6c-9c18-497f-93e3-95fef616791b req-24b94636-a61d-4bc1-a46c-5a402cb93f2b tempest-VolumesGetTestJSON-837743747 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:26:29 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-b6a0ce6c-9c18-497f-93e3-95fef616791b req-24b94636-a61d-4bc1-a46c-5a402cb93f2b tempest-VolumesGetTestJSON-837743747 None] Deleted volume successfully. Jul 10 00:26:29 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-b6a0ce6c-9c18-497f-93e3-95fef616791b req-24b94636-a61d-4bc1-a46c-5a402cb93f2b tempest-VolumesGetTestJSON-837743747 None] Lock "cinder-f913f951-7852-4813-990b-6790f533b2b9-delete_volume" released by "delete_volume" :: held 2.670s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:26:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:26:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:26:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:26:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:26:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:26:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:26:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:31 devstack sudo[93329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:26:31 devstack sudo[93329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:32 devstack sudo[93329]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.693s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:32 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:26:32 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:26:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 8 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:26:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:26:32 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-2507859c-ac12-44e7-9691-73a4e3dd1858 req-9265e0dd-70ef-4661-9796-9c14a123e358 tempest-ServerActionsTestOtherA-917121098 None] Terminate volume connection completed successfully. Jul 10 00:26:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-2507859c-ac12-44e7-9691-73a4e3dd1858 req-9265e0dd-70ef-4661-9796-9c14a123e358 tempest-ServerActionsTestOtherA-917121098 None] Deleting attachment 61c982d9-3295-4cbb-96f9-c87a20a7d949. {{(pid=88119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 10 00:26:33 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:26:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Flow 'volume_create_manager' (0b5286d5-4a82-40f8-8fb7-7cf47c51cc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:26:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c31c44e5-5cd5-4cb5-8628-fa8e8de20197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c31c44e5-5cd5-4cb5-8628-fa8e8de20197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-472378987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00b9a06d-f823-4ec5-a31b-2d61cb097642,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc4a6b298a194ab8857072dea4a27084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:26:33Z,use_quota=True,user_id='0d3b55a9e226438fbd447172d2d6838a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c6f499e-c1fb-4ead-bb6b-0fda46876a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c6f499e-c1fb-4ead-bb6b-0fda46876a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76aac319-b6da-49eb-818b-e3227ba84190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76aac319-b6da-49eb-818b-e3227ba84190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00b9a06d-f823-4ec5-a31b-2d61cb097642', 'volume_name': 'volume-00b9a06d-f823-4ec5-a31b-2d61cb097642', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eecbfa9c-3808-4f49-9f80-c9ac28fdee2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eecbfa9c-3808-4f49-9f80-c9ac28fdee2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15202a9-e2ff-4067-bb38-35b6465aa6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:33 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Volume 00b9a06d-f823-4ec5-a31b-2d61cb097642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00b9a06d-f823-4ec5-a31b-2d61cb097642', 'volume_size': 1} Jul 10 00:26:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:26:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:26:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-472378987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00b9a06d-f823-4ec5-a31b-2d61cb097642,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc4a6b298a194ab8857072dea4a27084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:26:33Z,use_quota=True,user_id='0d3b55a9e226438fbd447172d2d6838a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:26:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Creating volume 00b9a06d-f823-4ec5-a31b-2d61cb097642 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:26:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:26:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:26:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:26:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:26:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:26:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:26:33 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:26:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-00b9a06d-f823-4ec5-a31b-2d61cb097642 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:33 devstack sudo[93335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-00b9a06d-f823-4ec5-a31b-2d61cb097642 1073741824 Jul 10 00:26:33 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:34 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-00b9a06d-f823-4ec5-a31b-2d61cb097642 1073741824" returned: 0 in 0.823s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-00b9a06d-f823-4ec5-a31b-2d61cb097642 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:34 devstack sudo[93340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-00b9a06d-f823-4ec5-a31b-2d61cb097642 Jul 10 00:26:34 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:34 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-00b9a06d-f823-4ec5-a31b-2d61cb097642" returned: 0 in 0.672s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:26:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:26:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15202a9-e2ff-4067-bb38-35b6465aa6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00b9a06d-f823-4ec5-a31b-2d61cb097642', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c408c8c-eba2-4037-ad10-25f0237cd4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:34 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Volume volume-00b9a06d-f823-4ec5-a31b-2d61cb097642 (00b9a06d-f823-4ec5-a31b-2d61cb097642): created successfully Jul 10 00:26:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c408c8c-eba2-4037-ad10-25f0237cd4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Flow 'volume_create_manager' (0b5286d5-4a82-40f8-8fb7-7cf47c51cc83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:26:35 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-83a71c55-5ff5-4ace-b1d0-3b3e618ede8c tempest-VolumesTestJSON-1440527950 None] Created volume successfully. Jul 10 00:26:35 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:26:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Flow 'volume_create_manager' (84211db7-ec51-486a-a618-4792ff5f97ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:26:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (781fc18a-b552-44de-8fe4-2cfff71966d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (781fc18a-b552-44de-8fe4-2cfff71966d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1615253234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5769c16-6a4d-4337-8fc7-0a999096dae2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc4a6b298a194ab8857072dea4a27084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:26:36Z,use_quota=True,user_id='0d3b55a9e226438fbd447172d2d6838a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e700a18-7901-410e-ae5f-11a301c11f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e700a18-7901-410e-ae5f-11a301c11f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (705a5f1a-6726-4954-90f6-32e6ad208744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (705a5f1a-6726-4954-90f6-32e6ad208744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5769c16-6a4d-4337-8fc7-0a999096dae2', 'volume_name': 'volume-e5769c16-6a4d-4337-8fc7-0a999096dae2', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33859fd-0a6a-4f07-b291-28e9dc2f5413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33859fd-0a6a-4f07-b291-28e9dc2f5413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581607dd-d5a5-488b-8e0c-4e82c7aca808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:35 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Volume e5769c16-6a4d-4337-8fc7-0a999096dae2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5769c16-6a4d-4337-8fc7-0a999096dae2', 'volume_size': 1} Jul 10 00:26:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:26:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:26:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1615253234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5769c16-6a4d-4337-8fc7-0a999096dae2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc4a6b298a194ab8857072dea4a27084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:26:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:26:36Z,use_quota=True,user_id='0d3b55a9e226438fbd447172d2d6838a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:26:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Creating volume e5769c16-6a4d-4337-8fc7-0a999096dae2 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:26:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:26:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:26:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:26:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:26:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:26:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:26:35 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:26:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e5769c16-6a4d-4337-8fc7-0a999096dae2 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:35 devstack sudo[93346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e5769c16-6a4d-4337-8fc7-0a999096dae2 1073741824 Jul 10 00:26:35 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:36 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e5769c16-6a4d-4337-8fc7-0a999096dae2 1073741824" returned: 0 in 1.052s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e5769c16-6a4d-4337-8fc7-0a999096dae2 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:37 devstack sudo[93372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e5769c16-6a4d-4337-8fc7-0a999096dae2 Jul 10 00:26:37 devstack sudo[93372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:38 devstack sudo[93372]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e5769c16-6a4d-4337-8fc7-0a999096dae2" returned: 0 in 0.991s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:38 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] <== create_volume: return (2103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:26:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.105s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:26:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (581607dd-d5a5-488b-8e0c-4e82c7aca808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5769c16-6a4d-4337-8fc7-0a999096dae2', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788809ca-0b9c-4afd-ade0-33916015bbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:38 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Volume volume-e5769c16-6a4d-4337-8fc7-0a999096dae2 (e5769c16-6a4d-4337-8fc7-0a999096dae2): created successfully Jul 10 00:26:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788809ca-0b9c-4afd-ade0-33916015bbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Flow 'volume_create_manager' (84211db7-ec51-486a-a618-4792ff5f97ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:26:38 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-9d902e0f-8f38-49e0-9ab8-d3c1e11c33a8 tempest-VolumesTestJSON-1440527950 None] Created volume successfully. Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Flow 'volume_create_manager' (4c45040c-c3e9-4a1f-8f53-deddb9e177db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec376d62-db65-45df-bd8b-5e93fdbcbd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec376d62-db65-45df-bd8b-5e93fdbcbd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-52899272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf00c08-8b14-48cb-89bd-a959e5fc3c62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a13b1b0002a349ffb8c3dfdbb53557d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:26:39Z,use_quota=True,user_id='30dd5e96ae824db59bf3c51da32c254a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b990c3a3-8628-4f04-9aae-8e229c00509e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b990c3a3-8628-4f04-9aae-8e229c00509e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5232199-5870-4e31-a395-b399f06f21af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5232199-5870-4e31-a395-b399f06f21af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bf00c08-8b14-48cb-89bd-a959e5fc3c62', 'volume_name': 'volume-0bf00c08-8b14-48cb-89bd-a959e5fc3c62', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5feb6a-bff8-4211-a252-f83aa0198ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5feb6a-bff8-4211-a252-f83aa0198ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e15e994-1cf4-48b5-b1c5-4a5d61688ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:39 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Volume 0bf00c08-8b14-48cb-89bd-a959e5fc3c62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bf00c08-8b14-48cb-89bd-a959e5fc3c62', 'volume_size': 1} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-52899272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf00c08-8b14-48cb-89bd-a959e5fc3c62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a13b1b0002a349ffb8c3dfdbb53557d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:26:39Z,use_quota=True,user_id='30dd5e96ae824db59bf3c51da32c254a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Creating volume 0bf00c08-8b14-48cb-89bd-a959e5fc3c62 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:26:39 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-0bf00c08-8b14-48cb-89bd-a959e5fc3c62 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:39 devstack sudo[93384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-0bf00c08-8b14-48cb-89bd-a959e5fc3c62 1073741824 Jul 10 00:26:39 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Flow 'volume_create_manager' (93c6b4fa-890a-4d62-9382-e8f4210452d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e81ed27-0d0d-4d95-8e30-291e6ebe7dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e81ed27-0d0d-4d95-8e30-291e6ebe7dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1181992818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b54d30f-7711-4ca9-a32c-bb730b6ed7f3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc4a6b298a194ab8857072dea4a27084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:26:40Z,use_quota=True,user_id='0d3b55a9e226438fbd447172d2d6838a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d495cf94-3004-46c6-ad23-f8aa1efc2410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d495cf94-3004-46c6-ad23-f8aa1efc2410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ce0005-352a-4054-92d9-1f612662d66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ce0005-352a-4054-92d9-1f612662d66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b54d30f-7711-4ca9-a32c-bb730b6ed7f3', 'volume_name': 'volume-6b54d30f-7711-4ca9-a32c-bb730b6ed7f3', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4819122e-4377-412f-9261-43ff4271a9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4819122e-4377-412f-9261-43ff4271a9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d46484d-c3f7-4674-8cbc-df4a19677757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:39 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Volume 6b54d30f-7711-4ca9-a32c-bb730b6ed7f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b54d30f-7711-4ca9-a32c-bb730b6ed7f3', 'volume_size': 1} Jul 10 00:26:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:26:40 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-0bf00c08-8b14-48cb-89bd-a959e5fc3c62 1073741824" returned: 0 in 0.900s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-0bf00c08-8b14-48cb-89bd-a959e5fc3c62 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:40 devstack sudo[93393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-0bf00c08-8b14-48cb-89bd-a959e5fc3c62 Jul 10 00:26:40 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:40 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-0bf00c08-8b14-48cb-89bd-a959e5fc3c62" returned: 0 in 0.630s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:26:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:26:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.046s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:26:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1181992818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b54d30f-7711-4ca9-a32c-bb730b6ed7f3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc4a6b298a194ab8857072dea4a27084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:26:40Z,use_quota=True,user_id='0d3b55a9e226438fbd447172d2d6838a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:26:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Creating volume 6b54d30f-7711-4ca9-a32c-bb730b6ed7f3 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:26:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:26:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:26:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:26:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:26:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:26:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:26:40 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:26:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6b54d30f-7711-4ca9-a32c-bb730b6ed7f3 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:40 devstack sudo[93396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6b54d30f-7711-4ca9-a32c-bb730b6ed7f3 1073741824 Jul 10 00:26:40 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e15e994-1cf4-48b5-b1c5-4a5d61688ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bf00c08-8b14-48cb-89bd-a959e5fc3c62', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a43257a-605f-4e38-8a97-22610bcddc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:40 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Volume volume-0bf00c08-8b14-48cb-89bd-a959e5fc3c62 (0bf00c08-8b14-48cb-89bd-a959e5fc3c62): created successfully Jul 10 00:26:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a43257a-605f-4e38-8a97-22610bcddc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Flow 'volume_create_manager' (4c45040c-c3e9-4a1f-8f53-deddb9e177db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:26:40 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-5180ab1f-79c0-4133-a9cd-19cef2e04d87 tempest-AttachVolumeNegativeTest-1454311424 None] Created volume successfully. Jul 10 00:26:41 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6b54d30f-7711-4ca9-a32c-bb730b6ed7f3 1073741824" returned: 0 in 0.805s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6b54d30f-7711-4ca9-a32c-bb730b6ed7f3 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:41 devstack sudo[93405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6b54d30f-7711-4ca9-a32c-bb730b6ed7f3 Jul 10 00:26:41 devstack sudo[93405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:42 devstack sudo[93405]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6b54d30f-7711-4ca9-a32c-bb730b6ed7f3" returned: 0 in 0.699s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d46484d-c3f7-4674-8cbc-df4a19677757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b54d30f-7711-4ca9-a32c-bb730b6ed7f3', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0622573-d039-489a-8c21-f0264ae24d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:42 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Volume volume-6b54d30f-7711-4ca9-a32c-bb730b6ed7f3 (6b54d30f-7711-4ca9-a32c-bb730b6ed7f3): created successfully Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0622573-d039-489a-8c21-f0264ae24d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Flow 'volume_create_manager' (93c6b4fa-890a-4d62-9382-e8f4210452d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:26:42 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-bc13b187-fd63-4d21-8241-b193994a3df7 tempest-VolumesTestJSON-1440527950 None] Created volume successfully. Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Flow 'volume_create_manager' (40821a2a-6514-4e38-89fb-a29efe92534a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0211dee7-16bd-45d0-8bc9-e89463894554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0211dee7-16bd-45d0-8bc9-e89463894554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1019528665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d219371-b700-4022-8dd1-7491466e16c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e84a4a4b46b842149335af0352367657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:26:43Z,use_quota=True,user_id='fe5620c3f3af42b7bfa4a55bd15fdbcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e29635b-899a-4ac9-930c-58273685687d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e29635b-899a-4ac9-930c-58273685687d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d194843c-bd00-4430-ac0c-fa00fe7b53a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d194843c-bd00-4430-ac0c-fa00fe7b53a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d219371-b700-4022-8dd1-7491466e16c2', 'volume_name': 'volume-5d219371-b700-4022-8dd1-7491466e16c2', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4b8703-1a20-42b1-9a61-fd3896c87d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4b8703-1a20-42b1-9a61-fd3896c87d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d9f24cc-c0bf-4bdb-8393-51e960f00d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:42 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Volume 5d219371-b700-4022-8dd1-7491466e16c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d219371-b700-4022-8dd1-7491466e16c2', 'volume_size': 1} Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1019528665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d219371-b700-4022-8dd1-7491466e16c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e84a4a4b46b842149335af0352367657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:26:43Z,use_quota=True,user_id='fe5620c3f3af42b7bfa4a55bd15fdbcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Creating volume 5d219371-b700-4022-8dd1-7491466e16c2 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:26:42 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:26:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d219371-b700-4022-8dd1-7491466e16c2 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:42 devstack sudo[93414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d219371-b700-4022-8dd1-7491466e16c2 1073741824 Jul 10 00:26:42 devstack sudo[93414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-57bcc296-72f2-4682-bb0d-d4d81c03dc49 tempest-ServerActionsTestOtherA-917121098 None] Acquiring lock "cinder-d41e3d39-a5c1-4e30-a41e-5d04423f6b21-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:26:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-57bcc296-72f2-4682-bb0d-d4d81c03dc49 tempest-ServerActionsTestOtherA-917121098 None] Lock "cinder-d41e3d39-a5c1-4e30-a41e-5d04423f6b21-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:26:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-57bcc296-72f2-4682-bb0d-d4d81c03dc49 tempest-ServerActionsTestOtherA-917121098 None] Acquiring lock "cinder-quobyte-d41e3d39-a5c1-4e30-a41e-5d04423f6b21" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:26:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-57bcc296-72f2-4682-bb0d-d4d81c03dc49 tempest-ServerActionsTestOtherA-917121098 None] Lock "cinder-quobyte-d41e3d39-a5c1-4e30-a41e-5d04423f6b21" acquired by "delete_volume" :: waited 0.024s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:26:43 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fabbc2-e11e-4ba4-acd8-7ecdb57e489c]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:26:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-57bcc296-72f2-4682-bb0d-d4d81c03dc49 tempest-ServerActionsTestOtherA-917121098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d41e3d39-a5c1-4e30-a41e-5d04423f6b21 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:43 devstack sudo[93416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d41e3d39-a5c1-4e30-a41e-5d04423f6b21 Jul 10 00:26:43 devstack sudo[93416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-48625315-3f4a-42b0-9874-753369648688 tempest-VolumesTestJSON-1440527950 None] Acquiring lock "cinder-6b54d30f-7711-4ca9-a32c-bb730b6ed7f3-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:26:43 devstack sudo[93414]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d219371-b700-4022-8dd1-7491466e16c2 1073741824" returned: 0 in 1.031s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-48625315-3f4a-42b0-9874-753369648688 tempest-VolumesTestJSON-1440527950 None] Lock "cinder-6b54d30f-7711-4ca9-a32c-bb730b6ed7f3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:26:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d219371-b700-4022-8dd1-7491466e16c2 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-48625315-3f4a-42b0-9874-753369648688 tempest-VolumesTestJSON-1440527950 None] Acquiring lock "cinder-quobyte-6b54d30f-7711-4ca9-a32c-bb730b6ed7f3" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:26:43 devstack sudo[93423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d219371-b700-4022-8dd1-7491466e16c2 Jul 10 00:26:43 devstack sudo[93423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-48625315-3f4a-42b0-9874-753369648688 tempest-VolumesTestJSON-1440527950 None] Lock "cinder-quobyte-6b54d30f-7711-4ca9-a32c-bb730b6ed7f3" acquired by "delete_volume" :: waited 0.022s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:26:44 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf10b43-d772-4904-963d-7a3a3e2dad9d]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:26:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-48625315-3f4a-42b0-9874-753369648688 tempest-VolumesTestJSON-1440527950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6b54d30f-7711-4ca9-a32c-bb730b6ed7f3 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:44 devstack sudo[93425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6b54d30f-7711-4ca9-a32c-bb730b6ed7f3 Jul 10 00:26:44 devstack sudo[93425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-da38d071-98b1-4bf3-a872-ccc22a119fea req-69301f41-564c-4a9a-bf5e-754ef371f7b9 tempest-AttachVolumeNegativeTest-1454311424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:26:44 devstack sudo[93416]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-57bcc296-72f2-4682-bb0d-d4d81c03dc49 tempest-ServerActionsTestOtherA-917121098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d41e3d39-a5c1-4e30-a41e-5d04423f6b21" returned: 0 in 0.920s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-57bcc296-72f2-4682-bb0d-d4d81c03dc49 tempest-ServerActionsTestOtherA-917121098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d41e3d39-a5c1-4e30-a41e-5d04423f6b21 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:44 devstack sudo[93440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d41e3d39-a5c1-4e30-a41e-5d04423f6b21 Jul 10 00:26:44 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:44 devstack sudo[93423]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d219371-b700-4022-8dd1-7491466e16c2" returned: 0 in 0.705s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:26:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:26:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-da38d071-98b1-4bf3-a872-ccc22a119fea req-69301f41-564c-4a9a-bf5e-754ef371f7b9 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.398s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:26:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d9f24cc-c0bf-4bdb-8393-51e960f00d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d219371-b700-4022-8dd1-7491466e16c2', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e248ef33-a549-4be7-bc82-09de16555c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:44 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b9d9bf-a849-4344-8b13-8e0cd5836dc2]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:26:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-da38d071-98b1-4bf3-a872-ccc22a119fea req-69301f41-564c-4a9a-bf5e-754ef371f7b9 tempest-AttachVolumeNegativeTest-1454311424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-0bf00c08-8b14-48cb-89bd-a959e5fc3c62 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:44 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Volume volume-5d219371-b700-4022-8dd1-7491466e16c2 (5d219371-b700-4022-8dd1-7491466e16c2): created successfully Jul 10 00:26:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e248ef33-a549-4be7-bc82-09de16555c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Flow 'volume_create_manager' (40821a2a-6514-4e38-89fb-a29efe92534a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:26:44 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-2f40e36b-c6e0-420e-8199-b9516981ddd5 tempest-AttachVolumeTestJSON-630674806 None] Created volume successfully. Jul 10 00:26:44 devstack sudo[93446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-0bf00c08-8b14-48cb-89bd-a959e5fc3c62 Jul 10 00:26:44 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:44 devstack sudo[93425]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-48625315-3f4a-42b0-9874-753369648688 tempest-VolumesTestJSON-1440527950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6b54d30f-7711-4ca9-a32c-bb730b6ed7f3" returned: 0 in 0.932s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-48625315-3f4a-42b0-9874-753369648688 tempest-VolumesTestJSON-1440527950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6b54d30f-7711-4ca9-a32c-bb730b6ed7f3 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:44 devstack sudo[93449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6b54d30f-7711-4ca9-a32c-bb730b6ed7f3 Jul 10 00:26:44 devstack sudo[93449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:45 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-57bcc296-72f2-4682-bb0d-d4d81c03dc49 tempest-ServerActionsTestOtherA-917121098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d41e3d39-a5c1-4e30-a41e-5d04423f6b21" returned: 0 in 0.855s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-57bcc296-72f2-4682-bb0d-d4d81c03dc49 tempest-ServerActionsTestOtherA-917121098 None] Lock "cinder-quobyte-d41e3d39-a5c1-4e30-a41e-5d04423f6b21" released by "delete_volume" :: held 1.835s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:26:45 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-57bcc296-72f2-4682-bb0d-d4d81c03dc49 tempest-ServerActionsTestOtherA-917121098 None] Created reservations ['672013d0-9c8d-4fc0-a25d-544c45cc1897', '848271a0-c6fc-4a06-b067-7e61576779eb', '3538a9ee-bedd-4646-89b2-4b909a501824', '09911d65-af68-457d-9d9a-a737b5df6d8c'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:26:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-57bcc296-72f2-4682-bb0d-d4d81c03dc49 tempest-ServerActionsTestOtherA-917121098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:26:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-57bcc296-72f2-4682-bb0d-d4d81c03dc49 tempest-ServerActionsTestOtherA-917121098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:26:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-57bcc296-72f2-4682-bb0d-d4d81c03dc49 tempest-ServerActionsTestOtherA-917121098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:26:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-57bcc296-72f2-4682-bb0d-d4d81c03dc49 tempest-ServerActionsTestOtherA-917121098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:26:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-57bcc296-72f2-4682-bb0d-d4d81c03dc49 tempest-ServerActionsTestOtherA-917121098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:26:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-57bcc296-72f2-4682-bb0d-d4d81c03dc49 tempest-ServerActionsTestOtherA-917121098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:45 devstack sudo[93457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:26:45 devstack sudo[93457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:45 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-da38d071-98b1-4bf3-a872-ccc22a119fea req-69301f41-564c-4a9a-bf5e-754ef371f7b9 tempest-AttachVolumeNegativeTest-1454311424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-0bf00c08-8b14-48cb-89bd-a959e5fc3c62" returned: 0 in 0.868s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-da38d071-98b1-4bf3-a872-ccc22a119fea req-69301f41-564c-4a9a-bf5e-754ef371f7b9 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.909s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:26:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-da38d071-98b1-4bf3-a872-ccc22a119fea req-69301f41-564c-4a9a-bf5e-754ef371f7b9 tempest-AttachVolumeNegativeTest-1454311424 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff', 'name': 'volume-0bf00c08-8b14-48cb-89bd-a959e5fc3c62', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58fd0118-f680-4353-bbb6-a3c236b546dd', 'enforce_multipath': True} {{(pid=88119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 10 00:26:45 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-da38d071-98b1-4bf3-a872-ccc22a119fea req-69301f41-564c-4a9a-bf5e-754ef371f7b9 tempest-AttachVolumeNegativeTest-1454311424 None] attachment_update completed successfully. Jul 10 00:26:45 devstack sudo[93449]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-48625315-3f4a-42b0-9874-753369648688 tempest-VolumesTestJSON-1440527950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6b54d30f-7711-4ca9-a32c-bb730b6ed7f3" returned: 0 in 0.778s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-48625315-3f4a-42b0-9874-753369648688 tempest-VolumesTestJSON-1440527950 None] Lock "cinder-quobyte-6b54d30f-7711-4ca9-a32c-bb730b6ed7f3" released by "delete_volume" :: held 1.764s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:26:45 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-48625315-3f4a-42b0-9874-753369648688 tempest-VolumesTestJSON-1440527950 None] Created reservations ['eab9b54d-4810-4dcd-852d-3b1a39fac491', '94d636b2-256a-44e9-81b5-f1b1b6f20cbb', 'b53349f4-ccdc-4ec8-bd57-107e56863d12', '443f8ad6-4c04-4bae-a7b2-95e810496516'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:26:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-48625315-3f4a-42b0-9874-753369648688 tempest-VolumesTestJSON-1440527950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:26:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-48625315-3f4a-42b0-9874-753369648688 tempest-VolumesTestJSON-1440527950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:26:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-48625315-3f4a-42b0-9874-753369648688 tempest-VolumesTestJSON-1440527950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:26:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-48625315-3f4a-42b0-9874-753369648688 tempest-VolumesTestJSON-1440527950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:26:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-48625315-3f4a-42b0-9874-753369648688 tempest-VolumesTestJSON-1440527950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:26:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-48625315-3f4a-42b0-9874-753369648688 tempest-VolumesTestJSON-1440527950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:45 devstack sudo[93491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:26:45 devstack sudo[93491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-cbb2bc06-3856-4aee-9fda-0ac1e3b28ea1 tempest-VolumesTestJSON-1440527950 None] Acquiring lock "cinder-e5769c16-6a4d-4337-8fc7-0a999096dae2-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:26:46 devstack sudo[93457]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-57bcc296-72f2-4682-bb0d-d4d81c03dc49 tempest-ServerActionsTestOtherA-917121098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.875s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:46 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-57bcc296-72f2-4682-bb0d-d4d81c03dc49 tempest-ServerActionsTestOtherA-917121098 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:26:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-cbb2bc06-3856-4aee-9fda-0ac1e3b28ea1 tempest-VolumesTestJSON-1440527950 None] Lock "cinder-e5769c16-6a4d-4337-8fc7-0a999096dae2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:26:46 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-57bcc296-72f2-4682-bb0d-d4d81c03dc49 tempest-ServerActionsTestOtherA-917121098 None] Deleted volume successfully. Jul 10 00:26:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-57bcc296-72f2-4682-bb0d-d4d81c03dc49 tempest-ServerActionsTestOtherA-917121098 None] Lock "cinder-d41e3d39-a5c1-4e30-a41e-5d04423f6b21-delete_volume" released by "delete_volume" :: held 2.967s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:26:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-cbb2bc06-3856-4aee-9fda-0ac1e3b28ea1 tempest-VolumesTestJSON-1440527950 None] Acquiring lock "cinder-quobyte-e5769c16-6a4d-4337-8fc7-0a999096dae2" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:26:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-cbb2bc06-3856-4aee-9fda-0ac1e3b28ea1 tempest-VolumesTestJSON-1440527950 None] Lock "cinder-quobyte-e5769c16-6a4d-4337-8fc7-0a999096dae2" acquired by "delete_volume" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:26:46 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bab762c-81d6-4a23-8e91-ccb56814cdfd]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:26:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cbb2bc06-3856-4aee-9fda-0ac1e3b28ea1 tempest-VolumesTestJSON-1440527950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e5769c16-6a4d-4337-8fc7-0a999096dae2 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:46 devstack sudo[93534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e5769c16-6a4d-4337-8fc7-0a999096dae2 Jul 10 00:26:46 devstack sudo[93534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:46 devstack sudo[93491]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-48625315-3f4a-42b0-9874-753369648688 tempest-VolumesTestJSON-1440527950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.786s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:46 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-48625315-3f4a-42b0-9874-753369648688 tempest-VolumesTestJSON-1440527950 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:26:46 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-48625315-3f4a-42b0-9874-753369648688 tempest-VolumesTestJSON-1440527950 None] Deleted volume successfully. Jul 10 00:26:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-48625315-3f4a-42b0-9874-753369648688 tempest-VolumesTestJSON-1440527950 None] Lock "cinder-6b54d30f-7711-4ca9-a32c-bb730b6ed7f3-delete_volume" released by "delete_volume" :: held 2.829s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:26:47 devstack sudo[93534]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cbb2bc06-3856-4aee-9fda-0ac1e3b28ea1 tempest-VolumesTestJSON-1440527950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e5769c16-6a4d-4337-8fc7-0a999096dae2" returned: 0 in 0.796s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cbb2bc06-3856-4aee-9fda-0ac1e3b28ea1 tempest-VolumesTestJSON-1440527950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e5769c16-6a4d-4337-8fc7-0a999096dae2 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:47 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e5769c16-6a4d-4337-8fc7-0a999096dae2 Jul 10 00:26:47 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:48 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cbb2bc06-3856-4aee-9fda-0ac1e3b28ea1 tempest-VolumesTestJSON-1440527950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e5769c16-6a4d-4337-8fc7-0a999096dae2" returned: 0 in 0.958s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:48 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-cbb2bc06-3856-4aee-9fda-0ac1e3b28ea1 tempest-VolumesTestJSON-1440527950 None] Lock "cinder-quobyte-e5769c16-6a4d-4337-8fc7-0a999096dae2" released by "delete_volume" :: held 1.793s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:26:48 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-cbb2bc06-3856-4aee-9fda-0ac1e3b28ea1 tempest-VolumesTestJSON-1440527950 None] Created reservations ['7dee3e8f-8d1b-4c57-a62e-20d2fb31f420', 'd30470cf-d731-460a-a93e-7057c4c2c77d', 'dbc55bda-f5db-447d-b25f-19f5e851ca28', '744558a0-81e0-4082-bf0c-f6cf0cf0d8f0'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:26:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-cbb2bc06-3856-4aee-9fda-0ac1e3b28ea1 tempest-VolumesTestJSON-1440527950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:26:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-cbb2bc06-3856-4aee-9fda-0ac1e3b28ea1 tempest-VolumesTestJSON-1440527950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:26:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-cbb2bc06-3856-4aee-9fda-0ac1e3b28ea1 tempest-VolumesTestJSON-1440527950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:26:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-cbb2bc06-3856-4aee-9fda-0ac1e3b28ea1 tempest-VolumesTestJSON-1440527950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:26:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-cbb2bc06-3856-4aee-9fda-0ac1e3b28ea1 tempest-VolumesTestJSON-1440527950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:26:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cbb2bc06-3856-4aee-9fda-0ac1e3b28ea1 tempest-VolumesTestJSON-1440527950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:48 devstack sudo[93883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:26:48 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:48 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8304106e-0ce6-4997-a04c-04823c7e55d6 tempest-VolumesTestJSON-1440527950 None] Acquiring lock "cinder-00b9a06d-f823-4ec5-a31b-2d61cb097642-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:26:48 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8304106e-0ce6-4997-a04c-04823c7e55d6 tempest-VolumesTestJSON-1440527950 None] Lock "cinder-00b9a06d-f823-4ec5-a31b-2d61cb097642-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:26:48 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8304106e-0ce6-4997-a04c-04823c7e55d6 tempest-VolumesTestJSON-1440527950 None] Acquiring lock "cinder-quobyte-00b9a06d-f823-4ec5-a31b-2d61cb097642" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:26:48 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8304106e-0ce6-4997-a04c-04823c7e55d6 tempest-VolumesTestJSON-1440527950 None] Lock "cinder-quobyte-00b9a06d-f823-4ec5-a31b-2d61cb097642" acquired by "delete_volume" :: waited 0.024s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:26:48 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c39c17e-850a-4f06-b6fd-89121bd89474]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:26:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8304106e-0ce6-4997-a04c-04823c7e55d6 tempest-VolumesTestJSON-1440527950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-00b9a06d-f823-4ec5-a31b-2d61cb097642 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:48 devstack sudo[93892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-00b9a06d-f823-4ec5-a31b-2d61cb097642 Jul 10 00:26:48 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-90f67ba9-e312-4da2-a74a-1fa338f2013e req-cf8941b7-3a00-4e12-8abd-07f39bd21fb7 tempest-AttachVolumeTestJSON-630674806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:26:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-90f67ba9-e312-4da2-a74a-1fa338f2013e req-cf8941b7-3a00-4e12-8abd-07f39bd21fb7 tempest-AttachVolumeTestJSON-630674806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:26:48 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3e0e9d-a200-4139-83b8-230f51b627c6]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:26:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-90f67ba9-e312-4da2-a74a-1fa338f2013e req-cf8941b7-3a00-4e12-8abd-07f39bd21fb7 tempest-AttachVolumeTestJSON-630674806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d219371-b700-4022-8dd1-7491466e16c2 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:49 devstack sudo[93902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d219371-b700-4022-8dd1-7491466e16c2 Jul 10 00:26:49 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:49 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cbb2bc06-3856-4aee-9fda-0ac1e3b28ea1 tempest-VolumesTestJSON-1440527950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.877s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:49 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-cbb2bc06-3856-4aee-9fda-0ac1e3b28ea1 tempest-VolumesTestJSON-1440527950 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:26:49 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-cbb2bc06-3856-4aee-9fda-0ac1e3b28ea1 tempest-VolumesTestJSON-1440527950 None] Deleted volume successfully. Jul 10 00:26:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-cbb2bc06-3856-4aee-9fda-0ac1e3b28ea1 tempest-VolumesTestJSON-1440527950 None] Lock "cinder-e5769c16-6a4d-4337-8fc7-0a999096dae2-delete_volume" released by "delete_volume" :: held 2.954s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:26:49 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8304106e-0ce6-4997-a04c-04823c7e55d6 tempest-VolumesTestJSON-1440527950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-00b9a06d-f823-4ec5-a31b-2d61cb097642" returned: 0 in 0.947s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8304106e-0ce6-4997-a04c-04823c7e55d6 tempest-VolumesTestJSON-1440527950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-00b9a06d-f823-4ec5-a31b-2d61cb097642 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:49 devstack sudo[93910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-00b9a06d-f823-4ec5-a31b-2d61cb097642 Jul 10 00:26:49 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:49 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-90f67ba9-e312-4da2-a74a-1fa338f2013e req-cf8941b7-3a00-4e12-8abd-07f39bd21fb7 tempest-AttachVolumeTestJSON-630674806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d219371-b700-4022-8dd1-7491466e16c2" returned: 0 in 0.967s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-90f67ba9-e312-4da2-a74a-1fa338f2013e req-cf8941b7-3a00-4e12-8abd-07f39bd21fb7 tempest-AttachVolumeTestJSON-630674806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.991s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:26:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-90f67ba9-e312-4da2-a74a-1fa338f2013e req-cf8941b7-3a00-4e12-8abd-07f39bd21fb7 tempest-AttachVolumeTestJSON-630674806 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff', 'name': 'volume-5d219371-b700-4022-8dd1-7491466e16c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7110d171-8290-4cb6-b2ec-5d1d962bcb57', 'enforce_multipath': True} {{(pid=88119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 10 00:26:49 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-90f67ba9-e312-4da2-a74a-1fa338f2013e req-cf8941b7-3a00-4e12-8abd-07f39bd21fb7 tempest-AttachVolumeTestJSON-630674806 None] attachment_update completed successfully. Jul 10 00:26:50 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8304106e-0ce6-4997-a04c-04823c7e55d6 tempest-VolumesTestJSON-1440527950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-00b9a06d-f823-4ec5-a31b-2d61cb097642" returned: 0 in 0.681s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:50 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8304106e-0ce6-4997-a04c-04823c7e55d6 tempest-VolumesTestJSON-1440527950 None] Lock "cinder-quobyte-00b9a06d-f823-4ec5-a31b-2d61cb097642" released by "delete_volume" :: held 1.689s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:26:50 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-8304106e-0ce6-4997-a04c-04823c7e55d6 tempest-VolumesTestJSON-1440527950 None] Created reservations ['261a5bc8-915e-4a29-939d-4260d6b51d80', 'e8cb6bb2-6c11-4d4a-a960-c80583671448', '5d5137d0-8b2b-4b38-b1d9-b6e005d12562', '221c9033-1b5c-49c3-850b-60e474084cfe'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:26:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8304106e-0ce6-4997-a04c-04823c7e55d6 tempest-VolumesTestJSON-1440527950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:26:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8304106e-0ce6-4997-a04c-04823c7e55d6 tempest-VolumesTestJSON-1440527950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:26:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8304106e-0ce6-4997-a04c-04823c7e55d6 tempest-VolumesTestJSON-1440527950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:26:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8304106e-0ce6-4997-a04c-04823c7e55d6 tempest-VolumesTestJSON-1440527950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:26:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8304106e-0ce6-4997-a04c-04823c7e55d6 tempest-VolumesTestJSON-1440527950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:26:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8304106e-0ce6-4997-a04c-04823c7e55d6 tempest-VolumesTestJSON-1440527950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:50 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:26:50 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:51 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8304106e-0ce6-4997-a04c-04823c7e55d6 tempest-VolumesTestJSON-1440527950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.823s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:51 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-8304106e-0ce6-4997-a04c-04823c7e55d6 tempest-VolumesTestJSON-1440527950 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:26:51 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-8304106e-0ce6-4997-a04c-04823c7e55d6 tempest-VolumesTestJSON-1440527950 None] Deleted volume successfully. Jul 10 00:26:51 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8304106e-0ce6-4997-a04c-04823c7e55d6 tempest-VolumesTestJSON-1440527950 None] Lock "cinder-00b9a06d-f823-4ec5-a31b-2d61cb097642-delete_volume" released by "delete_volume" :: held 2.794s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:26:55 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:26:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Flow 'volume_create_manager' (9ebffc61-3168-46e1-a2e0-fb688b4df215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:26:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc32d0b-f219-42e1-a808-20d606c8f6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc32d0b-f219-42e1-a808-20d606c8f6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-594180289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352581dc-172a-4b2b-a7e2-e446be0f4290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc3a92889a44756a129284ae3471eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:26:55Z,use_quota=True,user_id='bded324837084df28bcdec33d9b555af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e4a6e6-78ca-47dc-a417-410f71393fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e4a6e6-78ca-47dc-a417-410f71393fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48fb359b-fd05-4bf7-b6d6-4fc6748fdcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48fb359b-fd05-4bf7-b6d6-4fc6748fdcbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '352581dc-172a-4b2b-a7e2-e446be0f4290', 'volume_name': 'volume-352581dc-172a-4b2b-a7e2-e446be0f4290', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb6a6862-0285-4194-b29d-5c7aa1dc63bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb6a6862-0285-4194-b29d-5c7aa1dc63bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f33222e-474a-4e4c-b335-1a9db6d4b413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:55 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Volume 352581dc-172a-4b2b-a7e2-e446be0f4290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-352581dc-172a-4b2b-a7e2-e446be0f4290', 'volume_size': 1} Jul 10 00:26:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:26:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:26:55 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-594180289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352581dc-172a-4b2b-a7e2-e446be0f4290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc3a92889a44756a129284ae3471eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:26:55Z,use_quota=True,user_id='bded324837084df28bcdec33d9b555af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:26:55 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Creating volume 352581dc-172a-4b2b-a7e2-e446be0f4290 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:26:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:26:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:26:55 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:26:55 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:26:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:26:55 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:26:55 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:26:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:55 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290 1073741824 Jul 10 00:26:55 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:56 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290 1073741824" returned: 0 in 0.854s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:56 devstack sudo[93936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290 Jul 10 00:26:56 devstack sudo[93936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:57 devstack sudo[93936]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290" returned: 0 in 0.725s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:57 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:26:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:26:57 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f33222e-474a-4e4c-b335-1a9db6d4b413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-352581dc-172a-4b2b-a7e2-e446be0f4290', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:57 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d65254-0b37-4cb6-bbfa-83858c37b83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:26:57 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Volume volume-352581dc-172a-4b2b-a7e2-e446be0f4290 (352581dc-172a-4b2b-a7e2-e446be0f4290): created successfully Jul 10 00:26:57 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0d65254-0b37-4cb6-bbfa-83858c37b83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:26:57 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Flow 'volume_create_manager' (9ebffc61-3168-46e1-a2e0-fb688b4df215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:26:57 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-fa89a77b-f7d7-4419-9a59-e512bc965010 tempest-SnapshotsActionsTest-965593556 None] Created volume successfully. Jul 10 00:26:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2d6bfbb4-0dbd-4dde-b27c-d65d62f74434 tempest-SnapshotsActionsTest-965593556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:26:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2d6bfbb4-0dbd-4dde-b27c-d65d62f74434 tempest-SnapshotsActionsTest-965593556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:26:57 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-2d6bfbb4-0dbd-4dde-b27c-d65d62f74434 tempest-SnapshotsActionsTest-965593556 None] Creating offline snapshot 7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 of volume 352581dc-172a-4b2b-a7e2-e446be0f4290 {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:26:57 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3c5255-4682-4985-a507-6b028b287066]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:26:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2d6bfbb4-0dbd-4dde-b27c-d65d62f74434 tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:57 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290 Jul 10 00:26:57 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:26:58 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Jul 10 00:26:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2d6bfbb4-0dbd-4dde-b27c-d65d62f74434 tempest-SnapshotsActionsTest-965593556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290" returned: 0 in 1.069s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:26:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2d6bfbb4-0dbd-4dde-b27c-d65d62f74434 tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:26:58 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 1G Jul 10 00:26:58 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:00 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2d6bfbb4-0dbd-4dde-b27c-d65d62f74434 tempest-SnapshotsActionsTest-965593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 1G" returned: 0 in 1.275s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2d6bfbb4-0dbd-4dde-b27c-d65d62f74434 tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-352581dc-172a-4b2b-a7e2-e446be0f4290 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:00 devstack sudo[93958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-352581dc-172a-4b2b-a7e2-e446be0f4290 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 Jul 10 00:27:00 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:01 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2d6bfbb4-0dbd-4dde-b27c-d65d62f74434 tempest-SnapshotsActionsTest-965593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-352581dc-172a-4b2b-a7e2-e446be0f4290 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5" returned: 0 in 1.119s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:01 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-2d6bfbb4-0dbd-4dde-b27c-d65d62f74434 tempest-SnapshotsActionsTest-965593556 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 is being set with open permissions: ugo+rw Jul 10 00:27:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2d6bfbb4-0dbd-4dde-b27c-d65d62f74434 tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:01 devstack sudo[93979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 Jul 10 00:27:01 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:01 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2d6bfbb4-0dbd-4dde-b27c-d65d62f74434 tempest-SnapshotsActionsTest-965593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5" returned: 0 in 0.758s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2d6bfbb4-0dbd-4dde-b27c-d65d62f74434 tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:02 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.info Jul 10 00:27:02 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:02 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2d6bfbb4-0dbd-4dde-b27c-d65d62f74434 tempest-SnapshotsActionsTest-965593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.info" returned: 0 in 0.751s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:02 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-2d6bfbb4-0dbd-4dde-b27c-d65d62f74434 tempest-SnapshotsActionsTest-965593556 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.info is being set with open permissions: ugo+rw Jul 10 00:27:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2d6bfbb4-0dbd-4dde-b27c-d65d62f74434 tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:02 devstack sudo[93987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.info Jul 10 00:27:02 devstack sudo[93987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:03 devstack sudo[93987]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2d6bfbb4-0dbd-4dde-b27c-d65d62f74434 tempest-SnapshotsActionsTest-965593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.info" returned: 0 in 0.690s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2d6bfbb4-0dbd-4dde-b27c-d65d62f74434 tempest-SnapshotsActionsTest-965593556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.780s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:27:03 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-2d6bfbb4-0dbd-4dde-b27c-d65d62f74434 tempest-SnapshotsActionsTest-965593556 None] Create snapshot completed successfully Jul 10 00:27:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5e56f6a3-bd20-43dd-be8c-ffcd24bf8ef1 tempest-SnapshotsActionsTest-965593556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:27:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5e56f6a3-bd20-43dd-be8c-ffcd24bf8ef1 tempest-SnapshotsActionsTest-965593556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:27:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-5e56f6a3-bd20-43dd-be8c-ffcd24bf8ef1 tempest-SnapshotsActionsTest-965593556 None] Creating offline snapshot 058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e of volume 352581dc-172a-4b2b-a7e2-e446be0f4290 {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:27:05 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[351847aa-3a62-499c-8bbb-6905dd9feebf]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:27:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5e56f6a3-bd20-43dd-be8c-ffcd24bf8ef1 tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:05 devstack sudo[94028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 Jul 10 00:27:05 devstack sudo[94028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:05 devstack sudo[94028]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5e56f6a3-bd20-43dd-be8c-ffcd24bf8ef1 tempest-SnapshotsActionsTest-965593556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5" returned: 0 in 0.867s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-5e56f6a3-bd20-43dd-be8c-ffcd24bf8ef1 tempest-SnapshotsActionsTest-965593556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-352581dc-172a-4b2b-a7e2-e446be0f4290(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:27:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5e56f6a3-bd20-43dd-be8c-ffcd24bf8ef1 tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:05 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e 1G Jul 10 00:27:05 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:07 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5e56f6a3-bd20-43dd-be8c-ffcd24bf8ef1 tempest-SnapshotsActionsTest-965593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e 1G" returned: 0 in 1.340s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5e56f6a3-bd20-43dd-be8c-ffcd24bf8ef1 tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:07 devstack sudo[94115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e Jul 10 00:27:07 devstack sudo[94115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:08 devstack sudo[94115]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5e56f6a3-bd20-43dd-be8c-ffcd24bf8ef1 tempest-SnapshotsActionsTest-965593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e" returned: 0 in 1.613s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:08 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-5e56f6a3-bd20-43dd-be8c-ffcd24bf8ef1 tempest-SnapshotsActionsTest-965593556 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e is being set with open permissions: ugo+rw Jul 10 00:27:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5e56f6a3-bd20-43dd-be8c-ffcd24bf8ef1 tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:09 devstack sudo[94180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e Jul 10 00:27:09 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:10 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5e56f6a3-bd20-43dd-be8c-ffcd24bf8ef1 tempest-SnapshotsActionsTest-965593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e" returned: 0 in 1.503s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5e56f6a3-bd20-43dd-be8c-ffcd24bf8ef1 tempest-SnapshotsActionsTest-965593556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.529s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:27:10 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-5e56f6a3-bd20-43dd-be8c-ffcd24bf8ef1 tempest-SnapshotsActionsTest-965593556 None] Create snapshot completed successfully Jul 10 00:27:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-592e0ddb-9296-4a8c-93d8-e387a5459a89 tempest-SnapshotsActionsTest-1729871635 None] Acquiring lock "cinder-058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:27:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-592e0ddb-9296-4a8c-93d8-e387a5459a89 tempest-SnapshotsActionsTest-1729871635 None] Lock "cinder-058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:27:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-592e0ddb-9296-4a8c-93d8-e387a5459a89 tempest-SnapshotsActionsTest-1729871635 None] Acquiring lock "cinder-quobyte-352581dc-172a-4b2b-a7e2-e446be0f4290" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:27:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-592e0ddb-9296-4a8c-93d8-e387a5459a89 tempest-SnapshotsActionsTest-1729871635 None] Lock "cinder-quobyte-352581dc-172a-4b2b-a7e2-e446be0f4290" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:27:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-592e0ddb-9296-4a8c-93d8-e387a5459a89 tempest-SnapshotsActionsTest-1729871635 None] Acquiring lock "cinder-quobyte-058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:27:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-592e0ddb-9296-4a8c-93d8-e387a5459a89 tempest-SnapshotsActionsTest-1729871635 None] Lock "cinder-quobyte-058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:27:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-592e0ddb-9296-4a8c-93d8-e387a5459a89 tempest-SnapshotsActionsTest-1729871635 None] Deleting offline snapshot 058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e of volume 352581dc-172a-4b2b-a7e2-e446be0f4290 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:27:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-592e0ddb-9296-4a8c-93d8-e387a5459a89 tempest-SnapshotsActionsTest-1729871635 None] snapshot_file for this snap is: volume-352581dc-172a-4b2b-a7e2-e446be0f4290.058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:27:11 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e80fe7-d1fe-4731-9baf-83977e1518ef]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:27:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-592e0ddb-9296-4a8c-93d8-e387a5459a89 tempest-SnapshotsActionsTest-1729871635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:12 devstack sudo[94198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e Jul 10 00:27:12 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:13 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-592e0ddb-9296-4a8c-93d8-e387a5459a89 tempest-SnapshotsActionsTest-1729871635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e" returned: 0 in 1.589s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-592e0ddb-9296-4a8c-93d8-e387a5459a89 tempest-SnapshotsActionsTest-1729871635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-352581dc-172a-4b2b-a7e2-e446be0f4290(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:27:13 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfeba280-3172-4383-8223-e7af70c7be4c]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:27:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-592e0ddb-9296-4a8c-93d8-e387a5459a89 tempest-SnapshotsActionsTest-1729871635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:13 devstack sudo[94204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 Jul 10 00:27:13 devstack sudo[94204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:15 devstack sudo[94204]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-592e0ddb-9296-4a8c-93d8-e387a5459a89 tempest-SnapshotsActionsTest-1729871635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5" returned: 0 in 1.716s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:15 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-592e0ddb-9296-4a8c-93d8-e387a5459a89 tempest-SnapshotsActionsTest-1729871635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-352581dc-172a-4b2b-a7e2-e446be0f4290(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:27:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-592e0ddb-9296-4a8c-93d8-e387a5459a89 tempest-SnapshotsActionsTest-1729871635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:15 devstack sudo[94213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e Jul 10 00:27:15 devstack sudo[94213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:16 devstack sudo[94213]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-592e0ddb-9296-4a8c-93d8-e387a5459a89 tempest-SnapshotsActionsTest-1729871635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e" returned: 0 in 1.185s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-592e0ddb-9296-4a8c-93d8-e387a5459a89 tempest-SnapshotsActionsTest-1729871635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:16 devstack sudo[94218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e Jul 10 00:27:16 devstack sudo[94218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:17 devstack sudo[94218]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-592e0ddb-9296-4a8c-93d8-e387a5459a89 tempest-SnapshotsActionsTest-1729871635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e" returned: 0 in 0.881s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:17 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-592e0ddb-9296-4a8c-93d8-e387a5459a89 tempest-SnapshotsActionsTest-1729871635 None] Lock "cinder-quobyte-058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e" released by "_delete_snapshot" :: held 5.546s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:27:17 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-592e0ddb-9296-4a8c-93d8-e387a5459a89 tempest-SnapshotsActionsTest-1729871635 None] Lock "cinder-quobyte-352581dc-172a-4b2b-a7e2-e446be0f4290" released by "delete_snapshot" :: held 5.582s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:27:17 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:UPDATE=70,cinder:SELECT=59,cinder:INSERT=10,cinder:DELETE=8 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:27:17 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=57,cinder:UPDATE=63,cinder:INSERT=18,cinder:DELETE=6 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:27:17 devstack cinder-volume[88119]: WARNING cinder.quota [None req-592e0ddb-9296-4a8c-93d8-e387a5459a89 tempest-SnapshotsActionsTest-1729871635 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:27:17 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-592e0ddb-9296-4a8c-93d8-e387a5459a89 tempest-SnapshotsActionsTest-1729871635 None] Created reservations ['c2082cd0-6917-497f-bf94-76498ab1ea8c', '88ae4337-e12b-4096-8dc3-d76ec0e8d562', '01886beb-95b5-4b70-bc02-065cfecfa3c3', '13db55a0-247e-4812-8e4b-f638a8b1d15b'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:27:17 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-592e0ddb-9296-4a8c-93d8-e387a5459a89 tempest-SnapshotsActionsTest-1729871635 None] Delete snapshot completed successfully. Jul 10 00:27:17 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-592e0ddb-9296-4a8c-93d8-e387a5459a89 tempest-SnapshotsActionsTest-1729871635 None] Lock "cinder-058f3ad7-37f7-4b54-9aa1-5bcda15e2d5e-delete_snapshot" released by "delete_snapshot" :: held 5.894s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:27:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-baceb006-6903-4c16-aa19-79ab26d81311 tempest-SnapshotsActionsTest-965593556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:27:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-baceb006-6903-4c16-aa19-79ab26d81311 tempest-SnapshotsActionsTest-965593556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:27:18 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-baceb006-6903-4c16-aa19-79ab26d81311 tempest-SnapshotsActionsTest-965593556 None] Creating offline snapshot 3d141aac-586e-44af-a19e-6500f4efb621 of volume 352581dc-172a-4b2b-a7e2-e446be0f4290 {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:27:18 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ae06d0-bc2f-4ac8-84ad-8733d59cb90b]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:27:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-baceb006-6903-4c16-aa19-79ab26d81311 tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:18 devstack sudo[94221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 Jul 10 00:27:18 devstack sudo[94221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:19 devstack sudo[94221]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-baceb006-6903-4c16-aa19-79ab26d81311 tempest-SnapshotsActionsTest-965593556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5" returned: 0 in 0.913s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-baceb006-6903-4c16-aa19-79ab26d81311 tempest-SnapshotsActionsTest-965593556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-352581dc-172a-4b2b-a7e2-e446be0f4290(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:27:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-baceb006-6903-4c16-aa19-79ab26d81311 tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.3d141aac-586e-44af-a19e-6500f4efb621 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:19 devstack sudo[94226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.3d141aac-586e-44af-a19e-6500f4efb621 1G Jul 10 00:27:19 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:20 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-baceb006-6903-4c16-aa19-79ab26d81311 tempest-SnapshotsActionsTest-965593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.3d141aac-586e-44af-a19e-6500f4efb621 1G" returned: 0 in 1.134s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-baceb006-6903-4c16-aa19-79ab26d81311 tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.3d141aac-586e-44af-a19e-6500f4efb621 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:20 devstack sudo[94234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.3d141aac-586e-44af-a19e-6500f4efb621 Jul 10 00:27:20 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:21 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-baceb006-6903-4c16-aa19-79ab26d81311 tempest-SnapshotsActionsTest-965593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.3d141aac-586e-44af-a19e-6500f4efb621" returned: 0 in 0.846s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:21 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-baceb006-6903-4c16-aa19-79ab26d81311 tempest-SnapshotsActionsTest-965593556 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.3d141aac-586e-44af-a19e-6500f4efb621 is being set with open permissions: ugo+rw Jul 10 00:27:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-baceb006-6903-4c16-aa19-79ab26d81311 tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.3d141aac-586e-44af-a19e-6500f4efb621 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:21 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.3d141aac-586e-44af-a19e-6500f4efb621 Jul 10 00:27:21 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:22 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-baceb006-6903-4c16-aa19-79ab26d81311 tempest-SnapshotsActionsTest-965593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.3d141aac-586e-44af-a19e-6500f4efb621" returned: 0 in 0.698s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-baceb006-6903-4c16-aa19-79ab26d81311 tempest-SnapshotsActionsTest-965593556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.700s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:27:22 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-baceb006-6903-4c16-aa19-79ab26d81311 tempest-SnapshotsActionsTest-965593556 None] Create snapshot completed successfully Jul 10 00:27:23 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-930ed4b4-6ea4-403c-beb7-a06fc047548e tempest-SnapshotsActionsTest-1729871635 None] Acquiring lock "cinder-3d141aac-586e-44af-a19e-6500f4efb621-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:27:23 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-930ed4b4-6ea4-403c-beb7-a06fc047548e tempest-SnapshotsActionsTest-1729871635 None] Lock "cinder-3d141aac-586e-44af-a19e-6500f4efb621-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:27:23 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-930ed4b4-6ea4-403c-beb7-a06fc047548e tempest-SnapshotsActionsTest-1729871635 None] Acquiring lock "cinder-quobyte-352581dc-172a-4b2b-a7e2-e446be0f4290" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:27:23 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-930ed4b4-6ea4-403c-beb7-a06fc047548e tempest-SnapshotsActionsTest-1729871635 None] Lock "cinder-quobyte-352581dc-172a-4b2b-a7e2-e446be0f4290" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:27:23 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-930ed4b4-6ea4-403c-beb7-a06fc047548e tempest-SnapshotsActionsTest-1729871635 None] Acquiring lock "cinder-quobyte-3d141aac-586e-44af-a19e-6500f4efb621" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:27:23 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-930ed4b4-6ea4-403c-beb7-a06fc047548e tempest-SnapshotsActionsTest-1729871635 None] Lock "cinder-quobyte-3d141aac-586e-44af-a19e-6500f4efb621" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:27:23 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-930ed4b4-6ea4-403c-beb7-a06fc047548e tempest-SnapshotsActionsTest-1729871635 None] Deleting offline snapshot 3d141aac-586e-44af-a19e-6500f4efb621 of volume 352581dc-172a-4b2b-a7e2-e446be0f4290 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:27:23 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-930ed4b4-6ea4-403c-beb7-a06fc047548e tempest-SnapshotsActionsTest-1729871635 None] snapshot_file for this snap is: volume-352581dc-172a-4b2b-a7e2-e446be0f4290.3d141aac-586e-44af-a19e-6500f4efb621 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:27:23 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[3630c8ca-942f-4366-a54d-26489acfb202]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:27:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-930ed4b4-6ea4-403c-beb7-a06fc047548e tempest-SnapshotsActionsTest-1729871635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.3d141aac-586e-44af-a19e-6500f4efb621 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:23 devstack sudo[94283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.3d141aac-586e-44af-a19e-6500f4efb621 Jul 10 00:27:23 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:24 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-930ed4b4-6ea4-403c-beb7-a06fc047548e tempest-SnapshotsActionsTest-1729871635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.3d141aac-586e-44af-a19e-6500f4efb621" returned: 0 in 0.781s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-930ed4b4-6ea4-403c-beb7-a06fc047548e tempest-SnapshotsActionsTest-1729871635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-352581dc-172a-4b2b-a7e2-e446be0f4290(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:27:24 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1844b2-5ffc-46f6-972f-d7de747be5f0]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:27:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-930ed4b4-6ea4-403c-beb7-a06fc047548e tempest-SnapshotsActionsTest-1729871635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:24 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 Jul 10 00:27:24 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:24 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-930ed4b4-6ea4-403c-beb7-a06fc047548e tempest-SnapshotsActionsTest-1729871635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5" returned: 0 in 0.801s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-930ed4b4-6ea4-403c-beb7-a06fc047548e tempest-SnapshotsActionsTest-1729871635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-352581dc-172a-4b2b-a7e2-e446be0f4290(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:27:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-930ed4b4-6ea4-403c-beb7-a06fc047548e tempest-SnapshotsActionsTest-1729871635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.3d141aac-586e-44af-a19e-6500f4efb621 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:24 devstack sudo[94302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.3d141aac-586e-44af-a19e-6500f4efb621 Jul 10 00:27:24 devstack sudo[94302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:25 devstack sudo[94302]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-930ed4b4-6ea4-403c-beb7-a06fc047548e tempest-SnapshotsActionsTest-1729871635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.3d141aac-586e-44af-a19e-6500f4efb621" returned: 0 in 0.827s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-930ed4b4-6ea4-403c-beb7-a06fc047548e tempest-SnapshotsActionsTest-1729871635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.3d141aac-586e-44af-a19e-6500f4efb621 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:25 devstack sudo[94307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.3d141aac-586e-44af-a19e-6500f4efb621 Jul 10 00:27:25 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:26 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-930ed4b4-6ea4-403c-beb7-a06fc047548e tempest-SnapshotsActionsTest-1729871635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.3d141aac-586e-44af-a19e-6500f4efb621" returned: 0 in 0.611s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-930ed4b4-6ea4-403c-beb7-a06fc047548e tempest-SnapshotsActionsTest-1729871635 None] Lock "cinder-quobyte-3d141aac-586e-44af-a19e-6500f4efb621" released by "_delete_snapshot" :: held 3.110s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:27:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-930ed4b4-6ea4-403c-beb7-a06fc047548e tempest-SnapshotsActionsTest-1729871635 None] Lock "cinder-quobyte-352581dc-172a-4b2b-a7e2-e446be0f4290" released by "delete_snapshot" :: held 3.137s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:27:26 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-930ed4b4-6ea4-403c-beb7-a06fc047548e tempest-SnapshotsActionsTest-1729871635 None] Created reservations ['80d5e3a6-25ad-47be-9588-13fd3b67731c', '858a332d-3908-460d-8295-d203bb8b8fd5', '50b47af0-d27e-4d49-a8f7-d6077a2803f3', '90e0550d-3bbf-477d-9808-6e58cb77f0d2'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:27:26 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-930ed4b4-6ea4-403c-beb7-a06fc047548e tempest-SnapshotsActionsTest-1729871635 None] Delete snapshot completed successfully. Jul 10 00:27:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-930ed4b4-6ea4-403c-beb7-a06fc047548e tempest-SnapshotsActionsTest-1729871635 None] Lock "cinder-3d141aac-586e-44af-a19e-6500f4efb621-delete_snapshot" released by "delete_snapshot" :: held 3.285s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:27:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8dabc9bc-dce0-4399-84a1-e622ab6b707a tempest-SnapshotsActionsTest-965593556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:27:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8dabc9bc-dce0-4399-84a1-e622ab6b707a tempest-SnapshotsActionsTest-965593556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:27:27 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8dabc9bc-dce0-4399-84a1-e622ab6b707a tempest-SnapshotsActionsTest-965593556 None] Creating offline snapshot 03b06a0d-d127-44b0-a8e0-00eaf551f27e of volume 352581dc-172a-4b2b-a7e2-e446be0f4290 {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:27:27 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[17654e35-fc26-4abf-8789-978ec1f10dde]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:27:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8dabc9bc-dce0-4399-84a1-e622ab6b707a tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:27 devstack sudo[94317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 Jul 10 00:27:27 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:28 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8dabc9bc-dce0-4399-84a1-e622ab6b707a tempest-SnapshotsActionsTest-965593556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5" returned: 0 in 1.035s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8dabc9bc-dce0-4399-84a1-e622ab6b707a tempest-SnapshotsActionsTest-965593556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-352581dc-172a-4b2b-a7e2-e446be0f4290(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:27:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8dabc9bc-dce0-4399-84a1-e622ab6b707a tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.03b06a0d-d127-44b0-a8e0-00eaf551f27e 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:28 devstack sudo[94352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.03b06a0d-d127-44b0-a8e0-00eaf551f27e 1G Jul 10 00:27:28 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:29 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8dabc9bc-dce0-4399-84a1-e622ab6b707a tempest-SnapshotsActionsTest-965593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.03b06a0d-d127-44b0-a8e0-00eaf551f27e 1G" returned: 0 in 0.876s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8dabc9bc-dce0-4399-84a1-e622ab6b707a tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.03b06a0d-d127-44b0-a8e0-00eaf551f27e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:29 devstack sudo[94368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.03b06a0d-d127-44b0-a8e0-00eaf551f27e Jul 10 00:27:29 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:30 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8dabc9bc-dce0-4399-84a1-e622ab6b707a tempest-SnapshotsActionsTest-965593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.03b06a0d-d127-44b0-a8e0-00eaf551f27e" returned: 0 in 0.675s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:30 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-8dabc9bc-dce0-4399-84a1-e622ab6b707a tempest-SnapshotsActionsTest-965593556 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.03b06a0d-d127-44b0-a8e0-00eaf551f27e is being set with open permissions: ugo+rw Jul 10 00:27:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8dabc9bc-dce0-4399-84a1-e622ab6b707a tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.03b06a0d-d127-44b0-a8e0-00eaf551f27e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:30 devstack sudo[94381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.03b06a0d-d127-44b0-a8e0-00eaf551f27e Jul 10 00:27:30 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:31 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8dabc9bc-dce0-4399-84a1-e622ab6b707a tempest-SnapshotsActionsTest-965593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.03b06a0d-d127-44b0-a8e0-00eaf551f27e" returned: 0 in 0.662s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8dabc9bc-dce0-4399-84a1-e622ab6b707a tempest-SnapshotsActionsTest-965593556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.366s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:27:31 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-8dabc9bc-dce0-4399-84a1-e622ab6b707a tempest-SnapshotsActionsTest-965593556 None] Create snapshot completed successfully Jul 10 00:27:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:27:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:27:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:27:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:27:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:27:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:27:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:31 devstack sudo[94384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:27:31 devstack sudo[94384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-118ce92c-5a41-4ab8-9d11-306c0b45d91c tempest-SnapshotsActionsTest-1729871635 None] Acquiring lock "cinder-03b06a0d-d127-44b0-a8e0-00eaf551f27e-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:27:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-118ce92c-5a41-4ab8-9d11-306c0b45d91c tempest-SnapshotsActionsTest-1729871635 None] Lock "cinder-03b06a0d-d127-44b0-a8e0-00eaf551f27e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:27:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-118ce92c-5a41-4ab8-9d11-306c0b45d91c tempest-SnapshotsActionsTest-1729871635 None] Acquiring lock "cinder-quobyte-352581dc-172a-4b2b-a7e2-e446be0f4290" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:27:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-118ce92c-5a41-4ab8-9d11-306c0b45d91c tempest-SnapshotsActionsTest-1729871635 None] Lock "cinder-quobyte-352581dc-172a-4b2b-a7e2-e446be0f4290" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:27:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-118ce92c-5a41-4ab8-9d11-306c0b45d91c tempest-SnapshotsActionsTest-1729871635 None] Acquiring lock "cinder-quobyte-03b06a0d-d127-44b0-a8e0-00eaf551f27e" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:27:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-118ce92c-5a41-4ab8-9d11-306c0b45d91c tempest-SnapshotsActionsTest-1729871635 None] Lock "cinder-quobyte-03b06a0d-d127-44b0-a8e0-00eaf551f27e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:27:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-118ce92c-5a41-4ab8-9d11-306c0b45d91c tempest-SnapshotsActionsTest-1729871635 None] Deleting offline snapshot 03b06a0d-d127-44b0-a8e0-00eaf551f27e of volume 352581dc-172a-4b2b-a7e2-e446be0f4290 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:27:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-118ce92c-5a41-4ab8-9d11-306c0b45d91c tempest-SnapshotsActionsTest-1729871635 None] snapshot_file for this snap is: volume-352581dc-172a-4b2b-a7e2-e446be0f4290.03b06a0d-d127-44b0-a8e0-00eaf551f27e {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:27:32 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75d604a-0847-4845-895c-59ce4fc78392]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:27:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-118ce92c-5a41-4ab8-9d11-306c0b45d91c tempest-SnapshotsActionsTest-1729871635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.03b06a0d-d127-44b0-a8e0-00eaf551f27e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:32 devstack sudo[94384]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.674s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:32 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:27:32 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:27:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 8 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:27:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:27:32 devstack sudo[94386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.03b06a0d-d127-44b0-a8e0-00eaf551f27e Jul 10 00:27:32 devstack sudo[94386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:33 devstack sudo[94386]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-118ce92c-5a41-4ab8-9d11-306c0b45d91c tempest-SnapshotsActionsTest-1729871635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.03b06a0d-d127-44b0-a8e0-00eaf551f27e" returned: 0 in 1.172s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-118ce92c-5a41-4ab8-9d11-306c0b45d91c tempest-SnapshotsActionsTest-1729871635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-352581dc-172a-4b2b-a7e2-e446be0f4290(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:27:33 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[539bb50b-01f2-4ffb-9159-2ffe2575cd9e]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:27:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-118ce92c-5a41-4ab8-9d11-306c0b45d91c tempest-SnapshotsActionsTest-1729871635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:33 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 Jul 10 00:27:33 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:34 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-118ce92c-5a41-4ab8-9d11-306c0b45d91c tempest-SnapshotsActionsTest-1729871635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5" returned: 0 in 0.965s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-118ce92c-5a41-4ab8-9d11-306c0b45d91c tempest-SnapshotsActionsTest-1729871635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-352581dc-172a-4b2b-a7e2-e446be0f4290(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:27:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-118ce92c-5a41-4ab8-9d11-306c0b45d91c tempest-SnapshotsActionsTest-1729871635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.03b06a0d-d127-44b0-a8e0-00eaf551f27e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:34 devstack sudo[94447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.03b06a0d-d127-44b0-a8e0-00eaf551f27e Jul 10 00:27:34 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:35 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-118ce92c-5a41-4ab8-9d11-306c0b45d91c tempest-SnapshotsActionsTest-1729871635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.03b06a0d-d127-44b0-a8e0-00eaf551f27e" returned: 0 in 0.881s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-118ce92c-5a41-4ab8-9d11-306c0b45d91c tempest-SnapshotsActionsTest-1729871635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.03b06a0d-d127-44b0-a8e0-00eaf551f27e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:35 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.03b06a0d-d127-44b0-a8e0-00eaf551f27e Jul 10 00:27:35 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:36 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-118ce92c-5a41-4ab8-9d11-306c0b45d91c tempest-SnapshotsActionsTest-1729871635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.03b06a0d-d127-44b0-a8e0-00eaf551f27e" returned: 0 in 0.925s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:36 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-118ce92c-5a41-4ab8-9d11-306c0b45d91c tempest-SnapshotsActionsTest-1729871635 None] Lock "cinder-quobyte-03b06a0d-d127-44b0-a8e0-00eaf551f27e" released by "_delete_snapshot" :: held 4.092s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:27:36 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-118ce92c-5a41-4ab8-9d11-306c0b45d91c tempest-SnapshotsActionsTest-1729871635 None] Lock "cinder-quobyte-352581dc-172a-4b2b-a7e2-e446be0f4290" released by "delete_snapshot" :: held 4.126s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:27:36 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-118ce92c-5a41-4ab8-9d11-306c0b45d91c tempest-SnapshotsActionsTest-1729871635 None] Created reservations ['276b28ae-7d65-4509-a80f-00991555be85', 'cef683ab-a51d-4a41-a773-9b3e7f21575a', '6afc1aaa-b9f0-4648-bc42-692b51757e81', '2c7f4cf7-4536-4dce-b3dd-9ba8ff9bd921'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:27:36 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-118ce92c-5a41-4ab8-9d11-306c0b45d91c tempest-SnapshotsActionsTest-1729871635 None] Delete snapshot completed successfully. Jul 10 00:27:36 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-118ce92c-5a41-4ab8-9d11-306c0b45d91c tempest-SnapshotsActionsTest-1729871635 None] Lock "cinder-03b06a0d-d127-44b0-a8e0-00eaf551f27e-delete_snapshot" released by "delete_snapshot" :: held 4.362s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:27:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-14246765-4d2e-409a-9362-accf06543c6f tempest-SnapshotsActionsTest-965593556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:27:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-14246765-4d2e-409a-9362-accf06543c6f tempest-SnapshotsActionsTest-965593556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:27:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-14246765-4d2e-409a-9362-accf06543c6f tempest-SnapshotsActionsTest-965593556 None] Creating offline snapshot 4b6676aa-876e-4de0-b7a6-5c5298df5c06 of volume 352581dc-172a-4b2b-a7e2-e446be0f4290 {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:27:37 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b367e0-2162-4379-855e-f66f85ff0eae]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:27:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-14246765-4d2e-409a-9362-accf06543c6f tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:38 devstack sudo[94508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 Jul 10 00:27:38 devstack sudo[94508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:38 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-ae6ba4d1-100f-44b2-8b15-dceb8d53c545 req-3a50f32a-9ba7-41c6-b07e-2737d800f868 tempest-AttachVolumeTestJSON-630674806 None] Terminate volume connection completed successfully. Jul 10 00:27:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-ae6ba4d1-100f-44b2-8b15-dceb8d53c545 req-3a50f32a-9ba7-41c6-b07e-2737d800f868 tempest-AttachVolumeTestJSON-630674806 None] Deleting attachment 7110d171-8290-4cb6-b2ec-5d1d962bcb57. {{(pid=88119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 10 00:27:38 devstack sudo[94508]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-14246765-4d2e-409a-9362-accf06543c6f tempest-SnapshotsActionsTest-965593556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5" returned: 0 in 1.097s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:38 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-14246765-4d2e-409a-9362-accf06543c6f tempest-SnapshotsActionsTest-965593556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-352581dc-172a-4b2b-a7e2-e446be0f4290(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:27:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-14246765-4d2e-409a-9362-accf06543c6f tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.4b6676aa-876e-4de0-b7a6-5c5298df5c06 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:38 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.4b6676aa-876e-4de0-b7a6-5c5298df5c06 1G Jul 10 00:27:38 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:40 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-14246765-4d2e-409a-9362-accf06543c6f tempest-SnapshotsActionsTest-965593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.4b6676aa-876e-4de0-b7a6-5c5298df5c06 1G" returned: 0 in 1.248s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-14246765-4d2e-409a-9362-accf06543c6f tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.4b6676aa-876e-4de0-b7a6-5c5298df5c06 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:40 devstack sudo[94525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.4b6676aa-876e-4de0-b7a6-5c5298df5c06 Jul 10 00:27:40 devstack sudo[94525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:40 devstack sudo[94525]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-14246765-4d2e-409a-9362-accf06543c6f tempest-SnapshotsActionsTest-965593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.4b6676aa-876e-4de0-b7a6-5c5298df5c06" returned: 0 in 0.756s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:40 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-14246765-4d2e-409a-9362-accf06543c6f tempest-SnapshotsActionsTest-965593556 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.4b6676aa-876e-4de0-b7a6-5c5298df5c06 is being set with open permissions: ugo+rw Jul 10 00:27:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-14246765-4d2e-409a-9362-accf06543c6f tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.4b6676aa-876e-4de0-b7a6-5c5298df5c06 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:40 devstack sudo[94530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.4b6676aa-876e-4de0-b7a6-5c5298df5c06 Jul 10 00:27:41 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:41 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-14246765-4d2e-409a-9362-accf06543c6f tempest-SnapshotsActionsTest-965593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.4b6676aa-876e-4de0-b7a6-5c5298df5c06" returned: 0 in 0.740s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-14246765-4d2e-409a-9362-accf06543c6f tempest-SnapshotsActionsTest-965593556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.965s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:27:41 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-14246765-4d2e-409a-9362-accf06543c6f tempest-SnapshotsActionsTest-965593556 None] Create snapshot completed successfully Jul 10 00:27:42 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-09e8478a-4037-470e-bd73-6d51db6c66e1 tempest-SnapshotsActionsTest-1729871635 None] Acquiring lock "cinder-4b6676aa-876e-4de0-b7a6-5c5298df5c06-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:27:42 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-09e8478a-4037-470e-bd73-6d51db6c66e1 tempest-SnapshotsActionsTest-1729871635 None] Lock "cinder-4b6676aa-876e-4de0-b7a6-5c5298df5c06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:27:42 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-09e8478a-4037-470e-bd73-6d51db6c66e1 tempest-SnapshotsActionsTest-1729871635 None] Acquiring lock "cinder-quobyte-352581dc-172a-4b2b-a7e2-e446be0f4290" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:27:42 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-09e8478a-4037-470e-bd73-6d51db6c66e1 tempest-SnapshotsActionsTest-1729871635 None] Lock "cinder-quobyte-352581dc-172a-4b2b-a7e2-e446be0f4290" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:27:42 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-09e8478a-4037-470e-bd73-6d51db6c66e1 tempest-SnapshotsActionsTest-1729871635 None] Acquiring lock "cinder-quobyte-4b6676aa-876e-4de0-b7a6-5c5298df5c06" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:27:42 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-09e8478a-4037-470e-bd73-6d51db6c66e1 tempest-SnapshotsActionsTest-1729871635 None] Lock "cinder-quobyte-4b6676aa-876e-4de0-b7a6-5c5298df5c06" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:27:42 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-09e8478a-4037-470e-bd73-6d51db6c66e1 tempest-SnapshotsActionsTest-1729871635 None] Deleting offline snapshot 4b6676aa-876e-4de0-b7a6-5c5298df5c06 of volume 352581dc-172a-4b2b-a7e2-e446be0f4290 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:27:42 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-09e8478a-4037-470e-bd73-6d51db6c66e1 tempest-SnapshotsActionsTest-1729871635 None] snapshot_file for this snap is: volume-352581dc-172a-4b2b-a7e2-e446be0f4290.4b6676aa-876e-4de0-b7a6-5c5298df5c06 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:27:42 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[885a6e5d-f292-4637-b5db-67df667746ba]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:27:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-09e8478a-4037-470e-bd73-6d51db6c66e1 tempest-SnapshotsActionsTest-1729871635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.4b6676aa-876e-4de0-b7a6-5c5298df5c06 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:42 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.4b6676aa-876e-4de0-b7a6-5c5298df5c06 Jul 10 00:27:42 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:43 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-09e8478a-4037-470e-bd73-6d51db6c66e1 tempest-SnapshotsActionsTest-1729871635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.4b6676aa-876e-4de0-b7a6-5c5298df5c06" returned: 0 in 1.002s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-09e8478a-4037-470e-bd73-6d51db6c66e1 tempest-SnapshotsActionsTest-1729871635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-352581dc-172a-4b2b-a7e2-e446be0f4290(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:27:43 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3225387-0322-48f2-8d7f-27e9cbf3f6b8]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:27:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-09e8478a-4037-470e-bd73-6d51db6c66e1 tempest-SnapshotsActionsTest-1729871635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:43 devstack sudo[94545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 Jul 10 00:27:43 devstack sudo[94545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:44 devstack sudo[94545]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-09e8478a-4037-470e-bd73-6d51db6c66e1 tempest-SnapshotsActionsTest-1729871635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5" returned: 0 in 0.825s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-09e8478a-4037-470e-bd73-6d51db6c66e1 tempest-SnapshotsActionsTest-1729871635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-352581dc-172a-4b2b-a7e2-e446be0f4290(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:27:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-09e8478a-4037-470e-bd73-6d51db6c66e1 tempest-SnapshotsActionsTest-1729871635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.4b6676aa-876e-4de0-b7a6-5c5298df5c06 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:44 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.4b6676aa-876e-4de0-b7a6-5c5298df5c06 Jul 10 00:27:44 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:44 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-5fe3b9b3-4d15-4ea5-bfda-fa8e30473be8 req-94f6b452-6246-4f99-8f4d-16e072d1fdda tempest-AttachVolumeNegativeTest-1454311424 None] Terminate volume connection completed successfully. Jul 10 00:27:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-5fe3b9b3-4d15-4ea5-bfda-fa8e30473be8 req-94f6b452-6246-4f99-8f4d-16e072d1fdda tempest-AttachVolumeNegativeTest-1454311424 None] Deleting attachment 58fd0118-f680-4353-bbb6-a3c236b546dd. {{(pid=88119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 10 00:27:45 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-09e8478a-4037-470e-bd73-6d51db6c66e1 tempest-SnapshotsActionsTest-1729871635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.4b6676aa-876e-4de0-b7a6-5c5298df5c06" returned: 0 in 0.848s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-09e8478a-4037-470e-bd73-6d51db6c66e1 tempest-SnapshotsActionsTest-1729871635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.4b6676aa-876e-4de0-b7a6-5c5298df5c06 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:45 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.4b6676aa-876e-4de0-b7a6-5c5298df5c06 Jul 10 00:27:45 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:45 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-09e8478a-4037-470e-bd73-6d51db6c66e1 tempest-SnapshotsActionsTest-1729871635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.4b6676aa-876e-4de0-b7a6-5c5298df5c06" returned: 0 in 0.694s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-09e8478a-4037-470e-bd73-6d51db6c66e1 tempest-SnapshotsActionsTest-1729871635 None] Lock "cinder-quobyte-4b6676aa-876e-4de0-b7a6-5c5298df5c06" released by "_delete_snapshot" :: held 3.502s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:27:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-09e8478a-4037-470e-bd73-6d51db6c66e1 tempest-SnapshotsActionsTest-1729871635 None] Lock "cinder-quobyte-352581dc-172a-4b2b-a7e2-e446be0f4290" released by "delete_snapshot" :: held 3.541s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:27:45 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-09e8478a-4037-470e-bd73-6d51db6c66e1 tempest-SnapshotsActionsTest-1729871635 None] Created reservations ['3fba0dc6-0ef7-4e5e-b4c0-cf662a33e948', '0692c0d0-d2aa-4efc-8f61-f22cc5a7d77a', '4c53a697-465f-4539-a1e9-cf7e817b01b5', 'da6d1d03-9f82-427e-b364-4871f569f5e3'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:27:45 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-09e8478a-4037-470e-bd73-6d51db6c66e1 tempest-SnapshotsActionsTest-1729871635 None] Delete snapshot completed successfully. Jul 10 00:27:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-09e8478a-4037-470e-bd73-6d51db6c66e1 tempest-SnapshotsActionsTest-1729871635 None] Lock "cinder-4b6676aa-876e-4de0-b7a6-5c5298df5c06-delete_snapshot" released by "delete_snapshot" :: held 3.717s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:27:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e0b1678d-d3f7-4577-b4c3-8d4cc6c83798 tempest-SnapshotsActionsTest-965593556 None] Acquiring lock "cinder-7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:27:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e0b1678d-d3f7-4577-b4c3-8d4cc6c83798 tempest-SnapshotsActionsTest-965593556 None] Lock "cinder-7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:27:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e0b1678d-d3f7-4577-b4c3-8d4cc6c83798 tempest-SnapshotsActionsTest-965593556 None] Acquiring lock "cinder-quobyte-352581dc-172a-4b2b-a7e2-e446be0f4290" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:27:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e0b1678d-d3f7-4577-b4c3-8d4cc6c83798 tempest-SnapshotsActionsTest-965593556 None] Lock "cinder-quobyte-352581dc-172a-4b2b-a7e2-e446be0f4290" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:27:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e0b1678d-d3f7-4577-b4c3-8d4cc6c83798 tempest-SnapshotsActionsTest-965593556 None] Acquiring lock "cinder-quobyte-7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:27:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e0b1678d-d3f7-4577-b4c3-8d4cc6c83798 tempest-SnapshotsActionsTest-965593556 None] Lock "cinder-quobyte-7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:27:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-e0b1678d-d3f7-4577-b4c3-8d4cc6c83798 tempest-SnapshotsActionsTest-965593556 None] Deleting offline snapshot 7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 of volume 352581dc-172a-4b2b-a7e2-e446be0f4290 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:27:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-e0b1678d-d3f7-4577-b4c3-8d4cc6c83798 tempest-SnapshotsActionsTest-965593556 None] snapshot_file for this snap is: volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:27:47 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ade7d9c-fba4-45ec-b21b-b6748d914a9d]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:27:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e0b1678d-d3f7-4577-b4c3-8d4cc6c83798 tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:47 devstack sudo[94564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 Jul 10 00:27:47 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:47 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e0b1678d-d3f7-4577-b4c3-8d4cc6c83798 tempest-SnapshotsActionsTest-965593556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5" returned: 0 in 0.852s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-e0b1678d-d3f7-4577-b4c3-8d4cc6c83798 tempest-SnapshotsActionsTest-965593556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-352581dc-172a-4b2b-a7e2-e446be0f4290(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:27:47 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[94740771-1ff0-4ca4-a29d-2d09bdbd447e]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:27:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e0b1678d-d3f7-4577-b4c3-8d4cc6c83798 tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:48 devstack sudo[94586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290 Jul 10 00:27:48 devstack sudo[94586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:49 devstack sudo[94586]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e0b1678d-d3f7-4577-b4c3-8d4cc6c83798 tempest-SnapshotsActionsTest-965593556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290" returned: 0 in 1.134s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e0b1678d-d3f7-4577-b4c3-8d4cc6c83798 tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:49 devstack sudo[94628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 Jul 10 00:27:49 devstack sudo[94628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:49 devstack sudo[94628]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e0b1678d-d3f7-4577-b4c3-8d4cc6c83798 tempest-SnapshotsActionsTest-965593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5" returned: 0 in 0.878s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e0b1678d-d3f7-4577-b4c3-8d4cc6c83798 tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:49 devstack sudo[94647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5 Jul 10 00:27:49 devstack sudo[94647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:50 devstack sudo[94647]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e0b1678d-d3f7-4577-b4c3-8d4cc6c83798 tempest-SnapshotsActionsTest-965593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290.7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5" returned: 0 in 0.811s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:50 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e0b1678d-d3f7-4577-b4c3-8d4cc6c83798 tempest-SnapshotsActionsTest-965593556 None] Lock "cinder-quobyte-7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5" released by "_delete_snapshot" :: held 3.792s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:27:50 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e0b1678d-d3f7-4577-b4c3-8d4cc6c83798 tempest-SnapshotsActionsTest-965593556 None] Lock "cinder-quobyte-352581dc-172a-4b2b-a7e2-e446be0f4290" released by "delete_snapshot" :: held 3.827s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:27:50 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-e0b1678d-d3f7-4577-b4c3-8d4cc6c83798 tempest-SnapshotsActionsTest-965593556 None] Created reservations ['f034735e-1990-4e40-805c-11efbbffac08', 'd7eab55e-8544-4ff6-ac62-83791efdcb70', '2b4c3866-0e68-4920-a9e1-54e4036ed1ff', 'f9284ddd-5320-4927-8cdb-73f0c7c67b44'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:27:50 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-e0b1678d-d3f7-4577-b4c3-8d4cc6c83798 tempest-SnapshotsActionsTest-965593556 None] Delete snapshot completed successfully. Jul 10 00:27:50 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e0b1678d-d3f7-4577-b4c3-8d4cc6c83798 tempest-SnapshotsActionsTest-965593556 None] Lock "cinder-7baa4d5a-a6f5-4d36-9ed8-d35f75e109e5-delete_snapshot" released by "delete_snapshot" :: held 3.995s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:27:51 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-00eaea1e-7919-4c18-a5fa-095adccbc9e6 tempest-SnapshotsActionsTest-965593556 None] Acquiring lock "cinder-352581dc-172a-4b2b-a7e2-e446be0f4290-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:27:51 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-00eaea1e-7919-4c18-a5fa-095adccbc9e6 tempest-SnapshotsActionsTest-965593556 None] Lock "cinder-352581dc-172a-4b2b-a7e2-e446be0f4290-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:27:51 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-00eaea1e-7919-4c18-a5fa-095adccbc9e6 tempest-SnapshotsActionsTest-965593556 None] Acquiring lock "cinder-quobyte-352581dc-172a-4b2b-a7e2-e446be0f4290" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:27:51 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-00eaea1e-7919-4c18-a5fa-095adccbc9e6 tempest-SnapshotsActionsTest-965593556 None] Lock "cinder-quobyte-352581dc-172a-4b2b-a7e2-e446be0f4290" acquired by "delete_volume" :: waited 0.026s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:27:51 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff073f8a-66fa-4e78-9d7f-59c769b5a834]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:27:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-00eaea1e-7919-4c18-a5fa-095adccbc9e6 tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:51 devstack sudo[94711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290 Jul 10 00:27:51 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:52 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-00eaea1e-7919-4c18-a5fa-095adccbc9e6 tempest-SnapshotsActionsTest-965593556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290" returned: 0 in 0.985s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-00eaea1e-7919-4c18-a5fa-095adccbc9e6 tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:52 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290 Jul 10 00:27:52 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:53 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-00eaea1e-7919-4c18-a5fa-095adccbc9e6 tempest-SnapshotsActionsTest-965593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-352581dc-172a-4b2b-a7e2-e446be0f4290" returned: 0 in 0.664s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-00eaea1e-7919-4c18-a5fa-095adccbc9e6 tempest-SnapshotsActionsTest-965593556 None] Lock "cinder-quobyte-352581dc-172a-4b2b-a7e2-e446be0f4290" released by "delete_volume" :: held 1.753s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:27:53 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-00eaea1e-7919-4c18-a5fa-095adccbc9e6 tempest-SnapshotsActionsTest-965593556 None] Created reservations ['103dc95a-16d4-45b5-bd2f-effe4e3f6092', 'd669067d-d402-4893-a5ba-4247a6da95de', '133a6973-b63e-49f6-adce-b07e79edcd77', 'c6aa52ee-d4b0-46a8-ac7f-0ce6537c7bac'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:27:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-00eaea1e-7919-4c18-a5fa-095adccbc9e6 tempest-SnapshotsActionsTest-965593556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:27:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-00eaea1e-7919-4c18-a5fa-095adccbc9e6 tempest-SnapshotsActionsTest-965593556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:27:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-00eaea1e-7919-4c18-a5fa-095adccbc9e6 tempest-SnapshotsActionsTest-965593556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:27:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-00eaea1e-7919-4c18-a5fa-095adccbc9e6 tempest-SnapshotsActionsTest-965593556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:27:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-00eaea1e-7919-4c18-a5fa-095adccbc9e6 tempest-SnapshotsActionsTest-965593556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:27:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-00eaea1e-7919-4c18-a5fa-095adccbc9e6 tempest-SnapshotsActionsTest-965593556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:27:53 devstack sudo[94734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:27:53 devstack sudo[94734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:27:54 devstack sudo[94734]: pam_unix(sudo:session): session closed for user root Jul 10 00:27:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-00eaea1e-7919-4c18-a5fa-095adccbc9e6 tempest-SnapshotsActionsTest-965593556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.912s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:27:54 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-00eaea1e-7919-4c18-a5fa-095adccbc9e6 tempest-SnapshotsActionsTest-965593556 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:27:54 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-00eaea1e-7919-4c18-a5fa-095adccbc9e6 tempest-SnapshotsActionsTest-965593556 None] Deleted volume successfully. Jul 10 00:27:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-00eaea1e-7919-4c18-a5fa-095adccbc9e6 tempest-SnapshotsActionsTest-965593556 None] Lock "cinder-352581dc-172a-4b2b-a7e2-e446be0f4290-delete_volume" released by "delete_volume" :: held 2.942s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:28:00 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:28:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Flow 'volume_create_manager' (204d980d-00b1-4e3c-ab24-960b507ec476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:28:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec816e7-3a54-420c-9f10-fa7e11498f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:28:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec816e7-3a54-420c-9f10-fa7e11498f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1718671211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b00129cc-7c2b-40ee-9b72-9548011aa22f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12bb53490e3d492aa8e6bc0bb8a1e776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:28:01Z,use_quota=True,user_id='9e365998ca1f4a9d992a311f6a9bbf70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:28:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f22b3cbe-d422-471e-be5b-94200b661bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:28:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f22b3cbe-d422-471e-be5b-94200b661bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:28:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f91a5f-a28a-40ec-a3c1-11c6817ce16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:28:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f91a5f-a28a-40ec-a3c1-11c6817ce16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b00129cc-7c2b-40ee-9b72-9548011aa22f', 'volume_name': 'volume-b00129cc-7c2b-40ee-9b72-9548011aa22f', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:28:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d15929-7711-4c4b-82a5-16367b508bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:28:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d15929-7711-4c4b-82a5-16367b508bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:28:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a5351e-8b05-4a56-8c0f-0739d045ab91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:28:00 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Volume b00129cc-7c2b-40ee-9b72-9548011aa22f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b00129cc-7c2b-40ee-9b72-9548011aa22f', 'volume_size': 1} Jul 10 00:28:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:28:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:28:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1718671211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b00129cc-7c2b-40ee-9b72-9548011aa22f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12bb53490e3d492aa8e6bc0bb8a1e776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:28:01Z,use_quota=True,user_id='9e365998ca1f4a9d992a311f6a9bbf70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:28:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Creating volume b00129cc-7c2b-40ee-9b72-9548011aa22f {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:28:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:28:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:28:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:28:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:28:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:28:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:28:00 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:28:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b00129cc-7c2b-40ee-9b72-9548011aa22f 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:28:00 devstack sudo[94744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b00129cc-7c2b-40ee-9b72-9548011aa22f 1073741824 Jul 10 00:28:00 devstack sudo[94744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:28:01 devstack sudo[94744]: pam_unix(sudo:session): session closed for user root Jul 10 00:28:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b00129cc-7c2b-40ee-9b72-9548011aa22f 1073741824" returned: 0 in 1.071s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:28:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b00129cc-7c2b-40ee-9b72-9548011aa22f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:28:01 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b00129cc-7c2b-40ee-9b72-9548011aa22f Jul 10 00:28:01 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Flow 'volume_create_manager' (8e7a4911-fb50-452c-b737-3fe1254e28ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70883aa5-134a-4f95-9ffd-86c17b473fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70883aa5-134a-4f95-9ffd-86c17b473fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1568897705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a500f9-d449-43a2-8040-bf66e91e68f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf5fe415fb64d6eb790c4a73ca7921e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:28:02Z,use_quota=True,user_id='a3286463be1743bcb6db3c129974be5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f9b5a1-0ac2-4caf-90fc-cbda880eb76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f9b5a1-0ac2-4caf-90fc-cbda880eb76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2499ea7e-d299-434a-aa0c-618cfd9beab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2499ea7e-d299-434a-aa0c-618cfd9beab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01a500f9-d449-43a2-8040-bf66e91e68f3', 'volume_name': 'volume-01a500f9-d449-43a2-8040-bf66e91e68f3', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2a63448-56ca-4dc3-800b-c3f9c2bf2c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2a63448-56ca-4dc3-800b-c3f9c2bf2c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf83db7-246e-47c6-b391-9a71a12dcd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:28:02 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Volume 01a500f9-d449-43a2-8040-bf66e91e68f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01a500f9-d449-43a2-8040-bf66e91e68f3', 'volume_size': 1} Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:28:02 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b00129cc-7c2b-40ee-9b72-9548011aa22f" returned: 0 in 0.810s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1568897705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a500f9-d449-43a2-8040-bf66e91e68f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf5fe415fb64d6eb790c4a73ca7921e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:28:02Z,use_quota=True,user_id='a3286463be1743bcb6db3c129974be5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Creating volume 01a500f9-d449-43a2-8040-bf66e91e68f3 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:28:02 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-01a500f9-d449-43a2-8040-bf66e91e68f3 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:28:02 devstack sudo[94754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-01a500f9-d449-43a2-8040-bf66e91e68f3 1073741824 Jul 10 00:28:02 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a5351e-8b05-4a56-8c0f-0739d045ab91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b00129cc-7c2b-40ee-9b72-9548011aa22f', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31db675e-be6a-4697-82c3-e996106f4b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:28:02 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Volume volume-b00129cc-7c2b-40ee-9b72-9548011aa22f (b00129cc-7c2b-40ee-9b72-9548011aa22f): created successfully Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31db675e-be6a-4697-82c3-e996106f4b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:28:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Flow 'volume_create_manager' (204d980d-00b1-4e3c-ab24-960b507ec476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:28:02 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-f6f454b0-78ea-413d-aa93-0c456b4bec9a tempest-AttachVolumeShelveTestJSON-1691203246 None] Created volume successfully. Jul 10 00:28:03 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root Jul 10 00:28:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-01a500f9-d449-43a2-8040-bf66e91e68f3 1073741824" returned: 0 in 0.943s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:28:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-01a500f9-d449-43a2-8040-bf66e91e68f3 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:28:03 devstack sudo[94759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-01a500f9-d449-43a2-8040-bf66e91e68f3 Jul 10 00:28:03 devstack sudo[94759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:28:04 devstack sudo[94759]: pam_unix(sudo:session): session closed for user root Jul 10 00:28:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-01a500f9-d449-43a2-8040-bf66e91e68f3" returned: 0 in 0.686s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:28:04 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:28:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:28:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf83db7-246e-47c6-b391-9a71a12dcd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01a500f9-d449-43a2-8040-bf66e91e68f3', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:28:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (142c930e-2a2c-41e9-b281-58d4b5bfb9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:28:04 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Volume volume-01a500f9-d449-43a2-8040-bf66e91e68f3 (01a500f9-d449-43a2-8040-bf66e91e68f3): created successfully Jul 10 00:28:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (142c930e-2a2c-41e9-b281-58d4b5bfb9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:28:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Flow 'volume_create_manager' (8e7a4911-fb50-452c-b737-3fe1254e28ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:28:04 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-7568788c-72b7-4c3e-9057-e17e03b616a2 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Created volume successfully. Jul 10 00:28:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-593a523f-aa84-4be5-8add-2a58207b837b tempest-VolumeQuotasAdminTestJSON-1954932028 None] Acquiring lock "cinder-01a500f9-d449-43a2-8040-bf66e91e68f3-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:28:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-593a523f-aa84-4be5-8add-2a58207b837b tempest-VolumeQuotasAdminTestJSON-1954932028 None] Lock "cinder-01a500f9-d449-43a2-8040-bf66e91e68f3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:28:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-593a523f-aa84-4be5-8add-2a58207b837b tempest-VolumeQuotasAdminTestJSON-1954932028 None] Acquiring lock "cinder-quobyte-01a500f9-d449-43a2-8040-bf66e91e68f3" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:28:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-593a523f-aa84-4be5-8add-2a58207b837b tempest-VolumeQuotasAdminTestJSON-1954932028 None] Lock "cinder-quobyte-01a500f9-d449-43a2-8040-bf66e91e68f3" acquired by "delete_volume" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:28:05 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf5e379-2d47-4c8e-a00a-b68c15091759]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:28:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-593a523f-aa84-4be5-8add-2a58207b837b tempest-VolumeQuotasAdminTestJSON-1954932028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-01a500f9-d449-43a2-8040-bf66e91e68f3 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:28:05 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-01a500f9-d449-43a2-8040-bf66e91e68f3 Jul 10 00:28:05 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:28:06 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Jul 10 00:28:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-593a523f-aa84-4be5-8add-2a58207b837b tempest-VolumeQuotasAdminTestJSON-1954932028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-01a500f9-d449-43a2-8040-bf66e91e68f3" returned: 0 in 0.819s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:28:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-593a523f-aa84-4be5-8add-2a58207b837b tempest-VolumeQuotasAdminTestJSON-1954932028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-01a500f9-d449-43a2-8040-bf66e91e68f3 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:28:06 devstack sudo[94784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-01a500f9-d449-43a2-8040-bf66e91e68f3 Jul 10 00:28:06 devstack sudo[94784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:28:07 devstack sudo[94784]: pam_unix(sudo:session): session closed for user root Jul 10 00:28:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-593a523f-aa84-4be5-8add-2a58207b837b tempest-VolumeQuotasAdminTestJSON-1954932028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-01a500f9-d449-43a2-8040-bf66e91e68f3" returned: 0 in 0.855s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:28:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-593a523f-aa84-4be5-8add-2a58207b837b tempest-VolumeQuotasAdminTestJSON-1954932028 None] Lock "cinder-quobyte-01a500f9-d449-43a2-8040-bf66e91e68f3" released by "delete_volume" :: held 1.716s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:28:07 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-593a523f-aa84-4be5-8add-2a58207b837b tempest-VolumeQuotasAdminTestJSON-1954932028 None] Created reservations ['a51a1e03-dace-4c13-b94b-47ed89654ebe', 'cf5cb96e-7717-4ddc-ba55-997e575dab42', 'c5ac81cd-d4fc-46d2-b6fe-db10a197123f', '79578efb-9b6b-4925-8c71-42bb4d5b9ebe'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:28:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-593a523f-aa84-4be5-8add-2a58207b837b tempest-VolumeQuotasAdminTestJSON-1954932028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:28:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-593a523f-aa84-4be5-8add-2a58207b837b tempest-VolumeQuotasAdminTestJSON-1954932028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:28:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-593a523f-aa84-4be5-8add-2a58207b837b tempest-VolumeQuotasAdminTestJSON-1954932028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:28:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-593a523f-aa84-4be5-8add-2a58207b837b tempest-VolumeQuotasAdminTestJSON-1954932028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:28:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-593a523f-aa84-4be5-8add-2a58207b837b tempest-VolumeQuotasAdminTestJSON-1954932028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:28:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-593a523f-aa84-4be5-8add-2a58207b837b tempest-VolumeQuotasAdminTestJSON-1954932028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:28:07 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:28:07 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:28:08 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Jul 10 00:28:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-593a523f-aa84-4be5-8add-2a58207b837b tempest-VolumeQuotasAdminTestJSON-1954932028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.050s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:28:08 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-593a523f-aa84-4be5-8add-2a58207b837b tempest-VolumeQuotasAdminTestJSON-1954932028 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:28:08 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-593a523f-aa84-4be5-8add-2a58207b837b tempest-VolumeQuotasAdminTestJSON-1954932028 None] Deleted volume successfully. Jul 10 00:28:08 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:28:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Flow 'volume_create_manager' (226624cb-6afd-475c-bb03-d72cba19dcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:28:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea8daaea-a7bb-4906-815e-e5d7274ad5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:28:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-593a523f-aa84-4be5-8add-2a58207b837b tempest-VolumeQuotasAdminTestJSON-1954932028 None] Lock "cinder-01a500f9-d449-43a2-8040-bf66e91e68f3-delete_volume" released by "delete_volume" :: held 3.058s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:28:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea8daaea-a7bb-4906-815e-e5d7274ad5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-406113592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c7426a3-dbef-4ae1-8338-bda30daee14d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf5fe415fb64d6eb790c4a73ca7921e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:28:08Z,use_quota=True,user_id='a3286463be1743bcb6db3c129974be5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:28:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a80b2a-7869-4e8b-beee-6018371e6474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:28:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8a80b2a-7869-4e8b-beee-6018371e6474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:28:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6bbf7fc-2536-4945-b6cf-90857c1f89c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:28:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6bbf7fc-2536-4945-b6cf-90857c1f89c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c7426a3-dbef-4ae1-8338-bda30daee14d', 'volume_name': 'volume-5c7426a3-dbef-4ae1-8338-bda30daee14d', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:28:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64413389-192b-4c27-bcae-2efbed72ca34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:28:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64413389-192b-4c27-bcae-2efbed72ca34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:28:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b08f0a-814e-4e61-b845-fc9a83a18039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:28:08 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Volume 5c7426a3-dbef-4ae1-8338-bda30daee14d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c7426a3-dbef-4ae1-8338-bda30daee14d', 'volume_size': 1} Jul 10 00:28:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:28:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:28:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-406113592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c7426a3-dbef-4ae1-8338-bda30daee14d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf5fe415fb64d6eb790c4a73ca7921e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:28:08Z,use_quota=True,user_id='a3286463be1743bcb6db3c129974be5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:28:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Creating volume 5c7426a3-dbef-4ae1-8338-bda30daee14d {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:28:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:28:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:28:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:28:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:28:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:28:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:28:08 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:28:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5c7426a3-dbef-4ae1-8338-bda30daee14d 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:28:08 devstack sudo[94818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5c7426a3-dbef-4ae1-8338-bda30daee14d 1073741824 Jul 10 00:28:08 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:28:09 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root Jul 10 00:28:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5c7426a3-dbef-4ae1-8338-bda30daee14d 1073741824" returned: 0 in 0.980s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:28:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5c7426a3-dbef-4ae1-8338-bda30daee14d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:28:09 devstack sudo[94841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5c7426a3-dbef-4ae1-8338-bda30daee14d Jul 10 00:28:09 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:28:10 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root Jul 10 00:28:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5c7426a3-dbef-4ae1-8338-bda30daee14d" returned: 0 in 0.724s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:28:10 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:28:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:28:10 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b08f0a-814e-4e61-b845-fc9a83a18039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c7426a3-dbef-4ae1-8338-bda30daee14d', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:28:10 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d365ce8a-9e11-4afa-a2db-e0f0b916544c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:28:10 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Volume volume-5c7426a3-dbef-4ae1-8338-bda30daee14d (5c7426a3-dbef-4ae1-8338-bda30daee14d): created successfully Jul 10 00:28:10 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d365ce8a-9e11-4afa-a2db-e0f0b916544c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:28:10 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Flow 'volume_create_manager' (226624cb-6afd-475c-bb03-d72cba19dcad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:28:10 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-c80df9b5-2063-4451-95d8-ee1368293675 tempest-VolumeQuotasAdminTestJSON-1954932028 None] Created volume successfully. Jul 10 00:28:11 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-ca5d750e-31fc-48d1-ac13-5fea7020eb05 tempest-VolumeQuotasAdminTestJSON-1165388084 None] Transfer volume completed successfully. Jul 10 00:28:12 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-0dafdde1-c546-4ddc-94f4-a16ae9c930d9 tempest-VolumeQuotasAdminTestJSON-818540825 None] Acquiring lock "cinder-5c7426a3-dbef-4ae1-8338-bda30daee14d-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:28:12 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-0dafdde1-c546-4ddc-94f4-a16ae9c930d9 tempest-VolumeQuotasAdminTestJSON-818540825 None] Lock "cinder-5c7426a3-dbef-4ae1-8338-bda30daee14d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:28:12 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-0dafdde1-c546-4ddc-94f4-a16ae9c930d9 tempest-VolumeQuotasAdminTestJSON-818540825 None] Acquiring lock "cinder-quobyte-5c7426a3-dbef-4ae1-8338-bda30daee14d" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:28:12 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-0dafdde1-c546-4ddc-94f4-a16ae9c930d9 tempest-VolumeQuotasAdminTestJSON-818540825 None] Lock "cinder-quobyte-5c7426a3-dbef-4ae1-8338-bda30daee14d" acquired by "delete_volume" :: waited 0.039s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:28:13 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d45452b-a56b-455b-ace8-63a302ca9919]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:28:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0dafdde1-c546-4ddc-94f4-a16ae9c930d9 tempest-VolumeQuotasAdminTestJSON-818540825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5c7426a3-dbef-4ae1-8338-bda30daee14d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:28:13 devstack sudo[94892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5c7426a3-dbef-4ae1-8338-bda30daee14d Jul 10 00:28:13 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:28:13 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root Jul 10 00:28:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0dafdde1-c546-4ddc-94f4-a16ae9c930d9 tempest-VolumeQuotasAdminTestJSON-818540825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5c7426a3-dbef-4ae1-8338-bda30daee14d" returned: 0 in 0.937s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:28:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0dafdde1-c546-4ddc-94f4-a16ae9c930d9 tempest-VolumeQuotasAdminTestJSON-818540825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5c7426a3-dbef-4ae1-8338-bda30daee14d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:28:14 devstack sudo[94917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5c7426a3-dbef-4ae1-8338-bda30daee14d Jul 10 00:28:14 devstack sudo[94917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:28:14 devstack sudo[94917]: pam_unix(sudo:session): session closed for user root Jul 10 00:28:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0dafdde1-c546-4ddc-94f4-a16ae9c930d9 tempest-VolumeQuotasAdminTestJSON-818540825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5c7426a3-dbef-4ae1-8338-bda30daee14d" returned: 0 in 0.747s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:28:14 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-0dafdde1-c546-4ddc-94f4-a16ae9c930d9 tempest-VolumeQuotasAdminTestJSON-818540825 None] Lock "cinder-quobyte-5c7426a3-dbef-4ae1-8338-bda30daee14d" released by "delete_volume" :: held 1.751s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:28:14 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-0dafdde1-c546-4ddc-94f4-a16ae9c930d9 tempest-VolumeQuotasAdminTestJSON-818540825 None] Created reservations ['ff2c2845-a167-46c5-9489-d2af2e93ef58', '0b9fc612-6fe0-4202-8d07-cb2c73dc60d5', 'cd09ea06-284d-472a-9818-737297af34e9', 'd1eaf544-97b1-464b-8744-7d7254688f5e'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:28:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0dafdde1-c546-4ddc-94f4-a16ae9c930d9 tempest-VolumeQuotasAdminTestJSON-818540825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:28:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0dafdde1-c546-4ddc-94f4-a16ae9c930d9 tempest-VolumeQuotasAdminTestJSON-818540825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:28:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0dafdde1-c546-4ddc-94f4-a16ae9c930d9 tempest-VolumeQuotasAdminTestJSON-818540825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:28:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0dafdde1-c546-4ddc-94f4-a16ae9c930d9 tempest-VolumeQuotasAdminTestJSON-818540825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:28:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0dafdde1-c546-4ddc-94f4-a16ae9c930d9 tempest-VolumeQuotasAdminTestJSON-818540825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:28:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0dafdde1-c546-4ddc-94f4-a16ae9c930d9 tempest-VolumeQuotasAdminTestJSON-818540825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:28:14 devstack sudo[94924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:28:14 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:28:15 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root Jul 10 00:28:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0dafdde1-c546-4ddc-94f4-a16ae9c930d9 tempest-VolumeQuotasAdminTestJSON-818540825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.068s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:28:15 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-0dafdde1-c546-4ddc-94f4-a16ae9c930d9 tempest-VolumeQuotasAdminTestJSON-818540825 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:28:15 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-0dafdde1-c546-4ddc-94f4-a16ae9c930d9 tempest-VolumeQuotasAdminTestJSON-818540825 None] Deleted volume successfully. Jul 10 00:28:16 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-0dafdde1-c546-4ddc-94f4-a16ae9c930d9 tempest-VolumeQuotasAdminTestJSON-818540825 None] Lock "cinder-5c7426a3-dbef-4ae1-8338-bda30daee14d-delete_volume" released by "delete_volume" :: held 3.122s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:28:22 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=61,cinder:INSERT=15,cinder:UPDATE=60,cinder:DELETE=3 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:28:22 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=49,cinder:INSERT=20,cinder:UPDATE=68,cinder:DELETE=6 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:28:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-79fa50a9-0ae6-4a05-8fba-530c93e368bc req-b71254cd-356e-40b5-99c8-09f8c6d1be99 tempest-AttachVolumeShelveTestJSON-1691203246 None] No connector for attachment bd331c86-008a-4a7f-8b05-a278ef39671e; skipping storage backend terminate_connection call. {{(pid=88119) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5011}} Jul 10 00:28:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-79fa50a9-0ae6-4a05-8fba-530c93e368bc req-b71254cd-356e-40b5-99c8-09f8c6d1be99 tempest-AttachVolumeShelveTestJSON-1691203246 None] Deleting attachment bd331c86-008a-4a7f-8b05-a278ef39671e. {{(pid=88119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 10 00:28:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:28:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:28:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:28:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:28:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:28:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:28:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:28:31 devstack sudo[95049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:28:31 devstack sudo[95049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:28:32 devstack sudo[95049]: pam_unix(sudo:session): session closed for user root Jul 10 00:28:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.836s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:28:32 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:28:32 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:28:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 8 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:28:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:28:40 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:28:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Flow 'volume_create_manager' (6262d3d3-226d-4b1c-98c2-45480d9cc982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:28:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7adbbd0-09f5-4450-bce2-b916024e63b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:28:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7adbbd0-09f5-4450-bce2-b916024e63b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1646305283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6732d530-c096-4388-bc50-c036dec99de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a13b1b0002a349ffb8c3dfdbb53557d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:28:41Z,use_quota=True,user_id='30dd5e96ae824db59bf3c51da32c254a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:28:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc4fa8a-c792-4eb1-b6fb-1051a8c49d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:28:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc4fa8a-c792-4eb1-b6fb-1051a8c49d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:28:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af197754-3c03-4302-a647-bf19201a21a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:28:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af197754-3c03-4302-a647-bf19201a21a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6732d530-c096-4388-bc50-c036dec99de0', 'volume_name': 'volume-6732d530-c096-4388-bc50-c036dec99de0', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:28:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51875089-31da-4216-8a82-6ed49910d720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:28:41 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51875089-31da-4216-8a82-6ed49910d720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:28:41 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a93c27b-0bc1-4646-90cf-0641f16101cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:28:41 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Volume 6732d530-c096-4388-bc50-c036dec99de0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6732d530-c096-4388-bc50-c036dec99de0', 'volume_size': 1} Jul 10 00:28:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:28:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:28:41 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1646305283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6732d530-c096-4388-bc50-c036dec99de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a13b1b0002a349ffb8c3dfdbb53557d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:28:41Z,use_quota=True,user_id='30dd5e96ae824db59bf3c51da32c254a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:28:41 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Creating volume 6732d530-c096-4388-bc50-c036dec99de0 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:28:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:28:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:28:41 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:28:41 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:28:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:28:41 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:28:41 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:28:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6732d530-c096-4388-bc50-c036dec99de0 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:28:41 devstack sudo[95120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6732d530-c096-4388-bc50-c036dec99de0 1073741824 Jul 10 00:28:41 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:28:42 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root Jul 10 00:28:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6732d530-c096-4388-bc50-c036dec99de0 1073741824" returned: 0 in 1.168s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:28:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6732d530-c096-4388-bc50-c036dec99de0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:28:42 devstack sudo[95159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6732d530-c096-4388-bc50-c036dec99de0 Jul 10 00:28:42 devstack sudo[95159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:28:43 devstack sudo[95159]: pam_unix(sudo:session): session closed for user root Jul 10 00:28:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6732d530-c096-4388-bc50-c036dec99de0" returned: 0 in 0.996s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:28:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] <== create_volume: return (2249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:28:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.251s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:28:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a93c27b-0bc1-4646-90cf-0641f16101cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6732d530-c096-4388-bc50-c036dec99de0', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:28:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb91b9c-8721-488b-82ff-51f94fb32d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:28:43 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Volume volume-6732d530-c096-4388-bc50-c036dec99de0 (6732d530-c096-4388-bc50-c036dec99de0): created successfully Jul 10 00:28:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb91b9c-8721-488b-82ff-51f94fb32d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:28:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Flow 'volume_create_manager' (6262d3d3-226d-4b1c-98c2-45480d9cc982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:28:43 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-18ebf883-af12-492f-9be3-a276a6fe43f8 tempest-AttachVolumeNegativeTest-1454311424 None] Created volume successfully. Jul 10 00:28:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-649396c8-51b8-433b-aa56-16a86a53b8dc req-24559af9-e803-47c6-a3f0-a0f1da387a53 tempest-AttachVolumeNegativeTest-1454311424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:28:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-649396c8-51b8-433b-aa56-16a86a53b8dc req-24559af9-e803-47c6-a3f0-a0f1da387a53 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:28:47 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[7751cd73-fb15-48cf-883d-b4b98155bda7]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:28:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-649396c8-51b8-433b-aa56-16a86a53b8dc req-24559af9-e803-47c6-a3f0-a0f1da387a53 tempest-AttachVolumeNegativeTest-1454311424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6732d530-c096-4388-bc50-c036dec99de0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:28:48 devstack sudo[95260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6732d530-c096-4388-bc50-c036dec99de0 Jul 10 00:28:48 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:28:49 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root Jul 10 00:28:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-649396c8-51b8-433b-aa56-16a86a53b8dc req-24559af9-e803-47c6-a3f0-a0f1da387a53 tempest-AttachVolumeNegativeTest-1454311424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6732d530-c096-4388-bc50-c036dec99de0" returned: 0 in 1.368s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:28:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-649396c8-51b8-433b-aa56-16a86a53b8dc req-24559af9-e803-47c6-a3f0-a0f1da387a53 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.402s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:28:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-649396c8-51b8-433b-aa56-16a86a53b8dc req-24559af9-e803-47c6-a3f0-a0f1da387a53 tempest-AttachVolumeNegativeTest-1454311424 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff', 'name': 'volume-6732d530-c096-4388-bc50-c036dec99de0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08f2ea1a-eaec-4b8b-a4b0-c2ca3dfbf361', 'enforce_multipath': True} {{(pid=88119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 10 00:28:49 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-649396c8-51b8-433b-aa56-16a86a53b8dc req-24559af9-e803-47c6-a3f0-a0f1da387a53 tempest-AttachVolumeNegativeTest-1454311424 None] attachment_update completed successfully. Jul 10 00:28:57 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-7acd9ac8-1bb0-44f5-80c9-7d860e6847ea req-dccce424-95a7-477f-9493-d00da976036a tempest-AttachVolumeNegativeTest-1454311424 None] Terminate volume connection completed successfully. Jul 10 00:28:57 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-7acd9ac8-1bb0-44f5-80c9-7d860e6847ea req-dccce424-95a7-477f-9493-d00da976036a tempest-AttachVolumeNegativeTest-1454311424 None] Deleting attachment 08f2ea1a-eaec-4b8b-a4b0-c2ca3dfbf361. {{(pid=88119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 10 00:29:07 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:29:07 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:UPDATE=4,cinder:SELECT=10 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:29:14 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:29:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Flow 'volume_create_manager' (ebfb4fb5-9a20-4ed0-accf-4b821e60b807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:29:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730abdd7-2bb2-4c9b-ac4c-ff6479b35335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730abdd7-2bb2-4c9b-ac4c-ff6479b35335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-991333942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e84a4a4b46b842149335af0352367657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:29:14Z,use_quota=True,user_id='fe5620c3f3af42b7bfa4a55bd15fdbcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13f56e6-5799-4527-a8fa-266a9061184e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13f56e6-5799-4527-a8fa-266a9061184e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abaf703-d448-43ba-bcc9-a484a72a2f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abaf703-d448-43ba-bcc9-a484a72a2f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0', 'volume_name': 'volume-6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2839731c-4f44-4ccc-b2a8-f11291f0e859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2839731c-4f44-4ccc-b2a8-f11291f0e859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58dcbfeb-cea0-4de5-a56c-34736f9b81db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:14 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Volume 6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0', 'volume_size': 1} Jul 10 00:29:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-991333942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e84a4a4b46b842149335af0352367657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:29:14Z,use_quota=True,user_id='fe5620c3f3af42b7bfa4a55bd15fdbcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:29:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Creating volume 6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:29:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:29:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:29:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:29:14 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:29:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:14 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0 1073741824 Jul 10 00:29:14 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:15 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0 1073741824" returned: 0 in 1.086s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:15 devstack sudo[95874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0 Jul 10 00:29:15 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:16 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0" returned: 0 in 1.020s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:16 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] <== create_volume: return (2163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:29:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.166s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58dcbfeb-cea0-4de5-a56c-34736f9b81db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99aee07b-8dae-4b6a-bd8e-bc81dd086013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:16 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Volume volume-6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0 (6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0): created successfully Jul 10 00:29:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99aee07b-8dae-4b6a-bd8e-bc81dd086013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Flow 'volume_create_manager' (ebfb4fb5-9a20-4ed0-accf-4b821e60b807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:29:16 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-f7945a26-0350-4b5f-a3cf-07616ac17c8a tempest-AttachVolumeTestJSON-630674806 None] Created volume successfully. Jul 10 00:29:17 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:29:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Flow 'volume_create_manager' (951ed1e2-8e73-40be-acd1-46e6f2ff63eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:29:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca63466f-27f3-4849-a134-a632a25ab114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca63466f-27f3-4849-a134-a632a25ab114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-886729393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7a63f2-fb0f-4b88-b78d-f9e7093fa774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e5287e938b41e9901e0039c8fb3341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:29:17Z,use_quota=True,user_id='55aaf8a6419441b28e7a1ab4b6dd41a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba8c67e-b350-4e98-91f3-84eb2feda502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ba8c67e-b350-4e98-91f3-84eb2feda502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (198d76a6-7d97-4adc-a10b-f74316796888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (198d76a6-7d97-4adc-a10b-f74316796888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b7a63f2-fb0f-4b88-b78d-f9e7093fa774', 'volume_name': 'volume-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc0e72e-2652-4e0b-94dc-8e25b0786dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc0e72e-2652-4e0b-94dc-8e25b0786dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb3bf48-ee84-44a3-bfc1-308607b9e0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:17 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Volume 8b7a63f2-fb0f-4b88-b78d-f9e7093fa774: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774', 'volume_size': 1} Jul 10 00:29:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-886729393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7a63f2-fb0f-4b88-b78d-f9e7093fa774,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e5287e938b41e9901e0039c8fb3341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:29:17Z,use_quota=True,user_id='55aaf8a6419441b28e7a1ab4b6dd41a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:29:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Creating volume 8b7a63f2-fb0f-4b88-b78d-f9e7093fa774 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:29:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:29:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:29:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:29:17 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:29:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:17 devstack sudo[95877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774 1073741824 Jul 10 00:29:17 devstack sudo[95877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:18 devstack sudo[95877]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774 1073741824" returned: 0 in 1.218s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:18 devstack sudo[95887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774 Jul 10 00:29:18 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:19 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774" returned: 0 in 1.039s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] <== create_volume: return (2308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:29:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.311s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb3bf48-ee84-44a3-bfc1-308607b9e0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2108b18f-cc01-4bef-bc6c-43a87d6f04a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:19 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Volume volume-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774 (8b7a63f2-fb0f-4b88-b78d-f9e7093fa774): created successfully Jul 10 00:29:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2108b18f-cc01-4bef-bc6c-43a87d6f04a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Flow 'volume_create_manager' (951ed1e2-8e73-40be-acd1-46e6f2ff63eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:29:19 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-fb4d63dd-4d6a-4b10-9a4a-e0730358dc33 tempest-VolumesActionsTest-1460527865 None] Created volume successfully. Jul 10 00:29:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1b2082c7-4f31-4452-a9e6-ecfdf5237dad tempest-AttachVolumeShelveTestJSON-1691203246 None] Acquiring lock "cinder-b00129cc-7c2b-40ee-9b72-9548011aa22f-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:29:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1b2082c7-4f31-4452-a9e6-ecfdf5237dad tempest-AttachVolumeShelveTestJSON-1691203246 None] Lock "cinder-b00129cc-7c2b-40ee-9b72-9548011aa22f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:29:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1b2082c7-4f31-4452-a9e6-ecfdf5237dad tempest-AttachVolumeShelveTestJSON-1691203246 None] Acquiring lock "cinder-quobyte-b00129cc-7c2b-40ee-9b72-9548011aa22f" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:29:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1b2082c7-4f31-4452-a9e6-ecfdf5237dad tempest-AttachVolumeShelveTestJSON-1691203246 None] Lock "cinder-quobyte-b00129cc-7c2b-40ee-9b72-9548011aa22f" acquired by "delete_volume" :: waited 0.035s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:29:20 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b91d2fe-b921-441e-9390-5bcac769d149]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:29:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1b2082c7-4f31-4452-a9e6-ecfdf5237dad tempest-AttachVolumeShelveTestJSON-1691203246 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b00129cc-7c2b-40ee-9b72-9548011aa22f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d40b580f-b20c-4796-a5e3-2475655ee3ff tempest-VolumesActionsTest-1460527865 None] Acquiring lock "cinder-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774" by "attach_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:29:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d40b580f-b20c-4796-a5e3-2475655ee3ff tempest-VolumesActionsTest-1460527865 None] Lock "cinder-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774" acquired by "attach_volume" :: waited 0.042s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:29:20 devstack sudo[95908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b00129cc-7c2b-40ee-9b72-9548011aa22f Jul 10 00:29:20 devstack sudo[95908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:20 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-d40b580f-b20c-4796-a5e3-2475655ee3ff tempest-VolumesActionsTest-1460527865 None] Attaching volume 8b7a63f2-fb0f-4b88-b78d-f9e7093fa774 to instance 8de69124-4089-4465-85a4-cc1c3611ad02 at mountpoint /dev/vdb on host None. Jul 10 00:29:20 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-d40b580f-b20c-4796-a5e3-2475655ee3ff tempest-VolumesActionsTest-1460527865 None] Attach volume completed successfully. Jul 10 00:29:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d40b580f-b20c-4796-a5e3-2475655ee3ff tempest-VolumesActionsTest-1460527865 None] Lock "cinder-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774" released by "attach_volume" :: held 0.161s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:29:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-f4f4fd1a-8675-41e1-bf10-76f54311de10 req-ccd36a76-f0e0-4727-b3c6-80fd38b41272 tempest-AttachVolumeTestJSON-630674806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-f4f4fd1a-8675-41e1-bf10-76f54311de10 req-ccd36a76-f0e0-4727-b3c6-80fd38b41272 tempest-AttachVolumeTestJSON-630674806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:21 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[74aab11c-396d-4574-bba5-7b12f6f50caf]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:29:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-f4f4fd1a-8675-41e1-bf10-76f54311de10 req-ccd36a76-f0e0-4727-b3c6-80fd38b41272 tempest-AttachVolumeTestJSON-630674806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:21 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0 Jul 10 00:29:21 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:21 devstack sudo[95908]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1b2082c7-4f31-4452-a9e6-ecfdf5237dad tempest-AttachVolumeShelveTestJSON-1691203246 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b00129cc-7c2b-40ee-9b72-9548011aa22f" returned: 0 in 1.168s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1b2082c7-4f31-4452-a9e6-ecfdf5237dad tempest-AttachVolumeShelveTestJSON-1691203246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b00129cc-7c2b-40ee-9b72-9548011aa22f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:21 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b00129cc-7c2b-40ee-9b72-9548011aa22f Jul 10 00:29:21 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:21 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-255e02d2-99c1-4da7-aebd-35297b7b296a tempest-VolumesActionsTest-129238514 None] Terminate volume connection completed successfully. Jul 10 00:29:22 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-255e02d2-99c1-4da7-aebd-35297b7b296a tempest-VolumesActionsTest-129238514 None] Acquiring lock "cinder-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774-detach_volume" by "detach_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:29:22 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-255e02d2-99c1-4da7-aebd-35297b7b296a tempest-VolumesActionsTest-129238514 None] Lock "cinder-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:29:22 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-255e02d2-99c1-4da7-aebd-35297b7b296a tempest-VolumesActionsTest-129238514 None] Detaching volume 8b7a63f2-fb0f-4b88-b78d-f9e7093fa774 from instance 8de69124-4089-4465-85a4-cc1c3611ad02. Jul 10 00:29:22 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-255e02d2-99c1-4da7-aebd-35297b7b296a tempest-VolumesActionsTest-129238514 None] Detach volume completed successfully. Jul 10 00:29:22 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-255e02d2-99c1-4da7-aebd-35297b7b296a tempest-VolumesActionsTest-129238514 None] Lock "cinder-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774-detach_volume" released by "detach_volume" :: held 0.176s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:29:22 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-f4f4fd1a-8675-41e1-bf10-76f54311de10 req-ccd36a76-f0e0-4727-b3c6-80fd38b41272 tempest-AttachVolumeTestJSON-630674806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0" returned: 0 in 1.134s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-f4f4fd1a-8675-41e1-bf10-76f54311de10 req-ccd36a76-f0e0-4727-b3c6-80fd38b41272 tempest-AttachVolumeTestJSON-630674806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.154s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:22 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1b2082c7-4f31-4452-a9e6-ecfdf5237dad tempest-AttachVolumeShelveTestJSON-1691203246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b00129cc-7c2b-40ee-9b72-9548011aa22f" returned: 0 in 0.896s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-f4f4fd1a-8675-41e1-bf10-76f54311de10 req-ccd36a76-f0e0-4727-b3c6-80fd38b41272 tempest-AttachVolumeTestJSON-630674806 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff', 'name': 'volume-6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f3ad8c3-6dd7-430e-be30-bf2fb1b8ed2a', 'enforce_multipath': True} {{(pid=88119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 10 00:29:22 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1b2082c7-4f31-4452-a9e6-ecfdf5237dad tempest-AttachVolumeShelveTestJSON-1691203246 None] Lock "cinder-quobyte-b00129cc-7c2b-40ee-9b72-9548011aa22f" released by "delete_volume" :: held 2.136s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:29:22 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-f4f4fd1a-8675-41e1-bf10-76f54311de10 req-ccd36a76-f0e0-4727-b3c6-80fd38b41272 tempest-AttachVolumeTestJSON-630674806 None] attachment_update completed successfully. Jul 10 00:29:22 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-1b2082c7-4f31-4452-a9e6-ecfdf5237dad tempest-AttachVolumeShelveTestJSON-1691203246 None] Created reservations ['ac7f441d-ad2c-420c-aac9-c56f965c67b8', '651558a5-ed25-46aa-8275-52fc00864174', 'cb020366-6bc1-44f0-ac25-ab0d52a4708a', 'ecf769e0-bdb7-4f2a-815a-035d7bfa800c'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:29:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1b2082c7-4f31-4452-a9e6-ecfdf5237dad tempest-AttachVolumeShelveTestJSON-1691203246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1b2082c7-4f31-4452-a9e6-ecfdf5237dad tempest-AttachVolumeShelveTestJSON-1691203246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:22 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1b2082c7-4f31-4452-a9e6-ecfdf5237dad tempest-AttachVolumeShelveTestJSON-1691203246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:29:22 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1b2082c7-4f31-4452-a9e6-ecfdf5237dad tempest-AttachVolumeShelveTestJSON-1691203246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:29:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1b2082c7-4f31-4452-a9e6-ecfdf5237dad tempest-AttachVolumeShelveTestJSON-1691203246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1b2082c7-4f31-4452-a9e6-ecfdf5237dad tempest-AttachVolumeShelveTestJSON-1691203246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:22 devstack sudo[95929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:29:22 devstack sudo[95929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:23 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-06a66c81-5cc9-46ee-9629-da6cef2dccb0 tempest-VolumesActionsTest-1460527865 None] Acquiring lock "cinder-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774-detach_volume" by "detach_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:29:23 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-06a66c81-5cc9-46ee-9629-da6cef2dccb0 tempest-VolumesActionsTest-1460527865 None] Lock "cinder-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:29:23 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-06a66c81-5cc9-46ee-9629-da6cef2dccb0 tempest-VolumesActionsTest-1460527865 None] Volume detach called, but volume not attached. Jul 10 00:29:23 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-06a66c81-5cc9-46ee-9629-da6cef2dccb0 tempest-VolumesActionsTest-1460527865 None] Lock "cinder-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774-detach_volume" released by "detach_volume" :: held 0.043s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:29:23 devstack sudo[95929]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1b2082c7-4f31-4452-a9e6-ecfdf5237dad tempest-AttachVolumeShelveTestJSON-1691203246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.366s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:24 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-1b2082c7-4f31-4452-a9e6-ecfdf5237dad tempest-AttachVolumeShelveTestJSON-1691203246 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:29:24 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-1b2082c7-4f31-4452-a9e6-ecfdf5237dad tempest-AttachVolumeShelveTestJSON-1691203246 None] Deleted volume successfully. Jul 10 00:29:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1b2082c7-4f31-4452-a9e6-ecfdf5237dad tempest-AttachVolumeShelveTestJSON-1691203246 None] Lock "cinder-b00129cc-7c2b-40ee-9b72-9548011aa22f-delete_volume" released by "delete_volume" :: held 3.815s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:29:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-66a3fdc3-ae70-4d07-9dc4-5c7189643435 tempest-VolumesActionsTest-1460527865 None] Acquiring lock "cinder-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:29:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-66a3fdc3-ae70-4d07-9dc4-5c7189643435 tempest-VolumesActionsTest-1460527865 None] Lock "cinder-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:29:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-66a3fdc3-ae70-4d07-9dc4-5c7189643435 tempest-VolumesActionsTest-1460527865 None] Acquiring lock "cinder-quobyte-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:29:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-66a3fdc3-ae70-4d07-9dc4-5c7189643435 tempest-VolumesActionsTest-1460527865 None] Lock "cinder-quobyte-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774" acquired by "delete_volume" :: waited 0.034s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:29:24 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[df778df7-9524-4879-810f-fbe7c78c9ce9]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:29:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-66a3fdc3-ae70-4d07-9dc4-5c7189643435 tempest-VolumesActionsTest-1460527865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:24 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774 Jul 10 00:29:24 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:25 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-66a3fdc3-ae70-4d07-9dc4-5c7189643435 tempest-VolumesActionsTest-1460527865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774" returned: 0 in 1.367s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-66a3fdc3-ae70-4d07-9dc4-5c7189643435 tempest-VolumesActionsTest-1460527865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:25 devstack sudo[96388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774 Jul 10 00:29:25 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:26 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-66a3fdc3-ae70-4d07-9dc4-5c7189643435 tempest-VolumesActionsTest-1460527865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774" returned: 0 in 0.874s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-66a3fdc3-ae70-4d07-9dc4-5c7189643435 tempest-VolumesActionsTest-1460527865 None] Lock "cinder-quobyte-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774" released by "delete_volume" :: held 2.381s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:29:26 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-66a3fdc3-ae70-4d07-9dc4-5c7189643435 tempest-VolumesActionsTest-1460527865 None] Created reservations ['04d7f64d-e807-4af6-907e-3558272dfcaf', '0b7848e4-1cf8-4bc4-9ea7-47096c38130a', 'c687134b-af5c-4715-9363-6ea44e8e7fa3', '817c9538-8c16-4a40-9641-3a2130a689c6'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:29:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-66a3fdc3-ae70-4d07-9dc4-5c7189643435 tempest-VolumesActionsTest-1460527865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-66a3fdc3-ae70-4d07-9dc4-5c7189643435 tempest-VolumesActionsTest-1460527865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-66a3fdc3-ae70-4d07-9dc4-5c7189643435 tempest-VolumesActionsTest-1460527865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:29:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-66a3fdc3-ae70-4d07-9dc4-5c7189643435 tempest-VolumesActionsTest-1460527865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:29:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-66a3fdc3-ae70-4d07-9dc4-5c7189643435 tempest-VolumesActionsTest-1460527865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-66a3fdc3-ae70-4d07-9dc4-5c7189643435 tempest-VolumesActionsTest-1460527865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:26 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:29:26 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:27 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-66a3fdc3-ae70-4d07-9dc4-5c7189643435 tempest-VolumesActionsTest-1460527865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.976s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:27 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-66a3fdc3-ae70-4d07-9dc4-5c7189643435 tempest-VolumesActionsTest-1460527865 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:29:27 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-66a3fdc3-ae70-4d07-9dc4-5c7189643435 tempest-VolumesActionsTest-1460527865 None] Deleted volume successfully. Jul 10 00:29:27 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-66a3fdc3-ae70-4d07-9dc4-5c7189643435 tempest-VolumesActionsTest-1460527865 None] Lock "cinder-8b7a63f2-fb0f-4b88-b78d-f9e7093fa774-delete_volume" released by "delete_volume" :: held 3.731s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:29:28 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:29:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Flow 'volume_create_manager' (0c34b768-498f-4449-8950-9126339f28fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:29:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f0044f-884a-43f3-8463-c79aa97533fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57f0044f-884a-43f3-8463-c79aa97533fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1718255500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea8e5cd-6641-4e28-bc60-efb130f2c2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e84a4a4b46b842149335af0352367657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:29:29Z,use_quota=True,user_id='fe5620c3f3af42b7bfa4a55bd15fdbcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d55f4209-9ee9-42fc-81e2-78ea8d795e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d55f4209-9ee9-42fc-81e2-78ea8d795e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ddca1eb-3ad2-493f-9466-ea7054650300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ddca1eb-3ad2-493f-9466-ea7054650300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ea8e5cd-6641-4e28-bc60-efb130f2c2be', 'volume_name': 'volume-3ea8e5cd-6641-4e28-bc60-efb130f2c2be', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc37495-ecdf-4fe6-8067-eb6b6e96390f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc37495-ecdf-4fe6-8067-eb6b6e96390f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa66f804-7c5b-4692-9c27-797696869872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:28 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Volume 3ea8e5cd-6641-4e28-bc60-efb130f2c2be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ea8e5cd-6641-4e28-bc60-efb130f2c2be', 'volume_size': 1} Jul 10 00:29:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1718255500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ea8e5cd-6641-4e28-bc60-efb130f2c2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e84a4a4b46b842149335af0352367657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:29:29Z,use_quota=True,user_id='fe5620c3f3af42b7bfa4a55bd15fdbcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:29:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Creating volume 3ea8e5cd-6641-4e28-bc60-efb130f2c2be {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:29:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:29:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:29:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:29:28 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:29:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3ea8e5cd-6641-4e28-bc60-efb130f2c2be 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:29 devstack sudo[96422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3ea8e5cd-6641-4e28-bc60-efb130f2c2be 1073741824 Jul 10 00:29:29 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:30 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3ea8e5cd-6641-4e28-bc60-efb130f2c2be 1073741824" returned: 0 in 1.557s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3ea8e5cd-6641-4e28-bc60-efb130f2c2be {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:30 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3ea8e5cd-6641-4e28-bc60-efb130f2c2be Jul 10 00:29:30 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:29:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:29:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:29:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:31 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:29:31 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:31 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3ea8e5cd-6641-4e28-bc60-efb130f2c2be" returned: 0 in 1.195s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] <== create_volume: return (2864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:29:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.866s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa66f804-7c5b-4692-9c27-797696869872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ea8e5cd-6641-4e28-bc60-efb130f2c2be', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb63937-7bda-4341-8556-c6d3e59a3f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:31 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Volume volume-3ea8e5cd-6641-4e28-bc60-efb130f2c2be (3ea8e5cd-6641-4e28-bc60-efb130f2c2be): created successfully Jul 10 00:29:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb63937-7bda-4341-8556-c6d3e59a3f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Flow 'volume_create_manager' (0c34b768-498f-4449-8950-9126339f28fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:29:31 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-dde47c7f-358a-445a-be11-ea2ba57746c3 tempest-AttachVolumeTestJSON-630674806 None] Created volume successfully. Jul 10 00:29:32 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.227s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:32 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:29:32 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:29:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 8 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:29:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:29:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-d0e7947f-e4d7-482f-be6b-504024240996 req-74efe3d1-0c58-4916-becd-db46b43a656e tempest-AttachVolumeTestJSON-630674806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-d0e7947f-e4d7-482f-be6b-504024240996 req-74efe3d1-0c58-4916-becd-db46b43a656e tempest-AttachVolumeTestJSON-630674806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:35 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e4d3eb-7f72-414e-a29c-157e37d1e85b]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:29:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-d0e7947f-e4d7-482f-be6b-504024240996 req-74efe3d1-0c58-4916-becd-db46b43a656e tempest-AttachVolumeTestJSON-630674806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3ea8e5cd-6641-4e28-bc60-efb130f2c2be {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:35 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3ea8e5cd-6641-4e28-bc60-efb130f2c2be Jul 10 00:29:35 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:36 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-d0e7947f-e4d7-482f-be6b-504024240996 req-74efe3d1-0c58-4916-becd-db46b43a656e tempest-AttachVolumeTestJSON-630674806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3ea8e5cd-6641-4e28-bc60-efb130f2c2be" returned: 0 in 0.941s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-d0e7947f-e4d7-482f-be6b-504024240996 req-74efe3d1-0c58-4916-becd-db46b43a656e tempest-AttachVolumeTestJSON-630674806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.971s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-d0e7947f-e4d7-482f-be6b-504024240996 req-74efe3d1-0c58-4916-becd-db46b43a656e tempest-AttachVolumeTestJSON-630674806 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff', 'name': 'volume-3ea8e5cd-6641-4e28-bc60-efb130f2c2be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b61311fa-290f-476d-bc21-6c8e03c2cb32', 'enforce_multipath': True} {{(pid=88119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 10 00:29:36 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-d0e7947f-e4d7-482f-be6b-504024240996 req-74efe3d1-0c58-4916-becd-db46b43a656e tempest-AttachVolumeTestJSON-630674806 None] attachment_update completed successfully. Jul 10 00:29:36 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:29:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Flow 'volume_create_manager' (cf73a2b4-cbd5-4686-9c87-e77b5b2785d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:29:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a093501-d8fd-4db3-bbc1-2070364d6ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a093501-d8fd-4db3-bbc1-2070364d6ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-203333755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c56379-dac5-4be5-9d20-99f801292e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e5287e938b41e9901e0039c8fb3341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:29:37Z,use_quota=True,user_id='55aaf8a6419441b28e7a1ab4b6dd41a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f9b49d-5f8c-4ffd-8574-c3b3eac0b404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f9b49d-5f8c-4ffd-8574-c3b3eac0b404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca902a6-912b-493a-9b5e-687061d63aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca902a6-912b-493a-9b5e-687061d63aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24c56379-dac5-4be5-9d20-99f801292e5d', 'volume_name': 'volume-24c56379-dac5-4be5-9d20-99f801292e5d', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa5600fc-455c-4c7c-bbba-14b43bd88f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa5600fc-455c-4c7c-bbba-14b43bd88f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d937481-1d5c-4c6b-b488-7a22fbe32b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:36 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Volume 24c56379-dac5-4be5-9d20-99f801292e5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24c56379-dac5-4be5-9d20-99f801292e5d', 'volume_size': 1} Jul 10 00:29:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:36 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-203333755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c56379-dac5-4be5-9d20-99f801292e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e5287e938b41e9901e0039c8fb3341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:29:37Z,use_quota=True,user_id='55aaf8a6419441b28e7a1ab4b6dd41a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:29:36 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Creating volume 24c56379-dac5-4be5-9d20-99f801292e5d {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:29:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:36 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:29:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:29:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:29:37 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:29:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-24c56379-dac5-4be5-9d20-99f801292e5d 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:37 devstack sudo[96506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-24c56379-dac5-4be5-9d20-99f801292e5d 1073741824 Jul 10 00:29:37 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:37 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-24c56379-dac5-4be5-9d20-99f801292e5d 1073741824" returned: 0 in 0.937s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-24c56379-dac5-4be5-9d20-99f801292e5d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:38 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-24c56379-dac5-4be5-9d20-99f801292e5d Jul 10 00:29:38 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:38 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-24c56379-dac5-4be5-9d20-99f801292e5d" returned: 0 in 0.711s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:38 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:29:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d937481-1d5c-4c6b-b488-7a22fbe32b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24c56379-dac5-4be5-9d20-99f801292e5d', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d034ebc4-cd98-40ea-9f4b-ac9f91548c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:38 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Volume volume-24c56379-dac5-4be5-9d20-99f801292e5d (24c56379-dac5-4be5-9d20-99f801292e5d): created successfully Jul 10 00:29:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d034ebc4-cd98-40ea-9f4b-ac9f91548c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Flow 'volume_create_manager' (cf73a2b4-cbd5-4686-9c87-e77b5b2785d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:29:38 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-52306b0d-0774-45a7-86eb-671ef0bbc292 tempest-VolumesActionsTest-1460527865 None] Created volume successfully. Jul 10 00:29:39 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a357ccc8-c823-4bfc-a565-30654b68e4b8 tempest-VolumesActionsTest-129238514 None] Acquiring lock "cinder-24c56379-dac5-4be5-9d20-99f801292e5d-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:29:39 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a357ccc8-c823-4bfc-a565-30654b68e4b8 tempest-VolumesActionsTest-129238514 None] Lock "cinder-24c56379-dac5-4be5-9d20-99f801292e5d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:29:39 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a357ccc8-c823-4bfc-a565-30654b68e4b8 tempest-VolumesActionsTest-129238514 None] Acquiring lock "cinder-quobyte-24c56379-dac5-4be5-9d20-99f801292e5d" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:29:39 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a357ccc8-c823-4bfc-a565-30654b68e4b8 tempest-VolumesActionsTest-129238514 None] Lock "cinder-quobyte-24c56379-dac5-4be5-9d20-99f801292e5d" acquired by "delete_volume" :: waited 0.029s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:29:39 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7efd37c-f78c-4c87-b1ca-c8d30cac4c55]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:29:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a357ccc8-c823-4bfc-a565-30654b68e4b8 tempest-VolumesActionsTest-129238514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-24c56379-dac5-4be5-9d20-99f801292e5d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:39 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-24c56379-dac5-4be5-9d20-99f801292e5d Jul 10 00:29:39 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:39 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-2482e546-4e97-491e-882f-0ea2451aa293 tempest-GroupSnapshotsTest-103019903 None] Group tempest-GroupSnapshotsTest-Group-2085266547: creating Jul 10 00:29:39 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-2482e546-4e97-491e-882f-0ea2451aa293 tempest-GroupSnapshotsTest-103019903 None] Group tempest-GroupSnapshotsTest-Group-2085266547: created successfully Jul 10 00:29:39 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-2482e546-4e97-491e-882f-0ea2451aa293 tempest-GroupSnapshotsTest-103019903 None] Create group completed successfully. Jul 10 00:29:40 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a357ccc8-c823-4bfc-a565-30654b68e4b8 tempest-VolumesActionsTest-129238514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-24c56379-dac5-4be5-9d20-99f801292e5d" returned: 0 in 0.833s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a357ccc8-c823-4bfc-a565-30654b68e4b8 tempest-VolumesActionsTest-129238514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-24c56379-dac5-4be5-9d20-99f801292e5d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:40 devstack sudo[96555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-24c56379-dac5-4be5-9d20-99f801292e5d Jul 10 00:29:40 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:40 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a357ccc8-c823-4bfc-a565-30654b68e4b8 tempest-VolumesActionsTest-129238514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-24c56379-dac5-4be5-9d20-99f801292e5d" returned: 0 in 0.670s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:40 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a357ccc8-c823-4bfc-a565-30654b68e4b8 tempest-VolumesActionsTest-129238514 None] Lock "cinder-quobyte-24c56379-dac5-4be5-9d20-99f801292e5d" released by "delete_volume" :: held 1.566s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:29:40 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-a357ccc8-c823-4bfc-a565-30654b68e4b8 tempest-VolumesActionsTest-129238514 None] Created reservations ['ed1bfa9d-8e06-44cc-9965-74e4d9e73118', '75daa40c-6c04-465b-b040-24bcc91b3f5b', '283aaba8-3b0f-435b-9c38-02e59a980d5e', 'fad1e37a-bb89-405f-bfb3-d498fb5cd3fc'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:29:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a357ccc8-c823-4bfc-a565-30654b68e4b8 tempest-VolumesActionsTest-129238514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a357ccc8-c823-4bfc-a565-30654b68e4b8 tempest-VolumesActionsTest-129238514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a357ccc8-c823-4bfc-a565-30654b68e4b8 tempest-VolumesActionsTest-129238514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:29:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a357ccc8-c823-4bfc-a565-30654b68e4b8 tempest-VolumesActionsTest-129238514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:29:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a357ccc8-c823-4bfc-a565-30654b68e4b8 tempest-VolumesActionsTest-129238514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a357ccc8-c823-4bfc-a565-30654b68e4b8 tempest-VolumesActionsTest-129238514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:40 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:29:40 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:29:41 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Flow 'volume_create_manager' (db6205bc-7ead-47be-b216-6d3382d07a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f49b028-3a66-4a8a-a80a-4d758e609689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a357ccc8-c823-4bfc-a565-30654b68e4b8 tempest-VolumesActionsTest-129238514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.703s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-a357ccc8-c823-4bfc-a565-30654b68e4b8 tempest-VolumesActionsTest-129238514 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f49b028-3a66-4a8a-a80a-4d758e609689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-463595392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78a4c159-b25f-43a8-adf9-f6cd583c3f5f,host='devstack@QuobyteHD#QuobyteHD',id=3b1b0b19-88af-4771-b7f9-8aa1956e258f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfeb9ad7d9a1491db2b0bab27b2d61e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:29:42Z,use_quota=True,user_id='8253e96f724d430f8fab1cb90d9aa3c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83da2dbc-b761-44f4-8de2-0ee24a0b1fda),volume_type_id=83da2dbc-b761-44f4-8de2-0ee24a0b1fda)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63452df-8d7a-4e77-9824-064e76217ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63452df-8d7a-4e77-9824-064e76217ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88df460-102e-41a5-8376-07d2e108e403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88df460-102e-41a5-8376-07d2e108e403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b1b0b19-88af-4771-b7f9-8aa1956e258f', 'volume_name': 'volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a111288-33bc-4975-af0b-7cadf2fbd4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a111288-33bc-4975-af0b-7cadf2fbd4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2528e07a-564a-4d9f-9f20-338dfad0fd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:41 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Volume 3b1b0b19-88af-4771-b7f9-8aa1956e258f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f', 'volume_size': 1} Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=78a4c159-b25f-43a8-adf9-f6cd583c3f5f,created_at=2026-07-09T22:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-463595392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78a4c159-b25f-43a8-adf9-f6cd583c3f5f,host='devstack@QuobyteHD#QuobyteHD',id=3b1b0b19-88af-4771-b7f9-8aa1956e258f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfeb9ad7d9a1491db2b0bab27b2d61e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:29:42Z,use_quota=True,user_id='8253e96f724d430f8fab1cb90d9aa3c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83da2dbc-b761-44f4-8de2-0ee24a0b1fda),volume_type_id=83da2dbc-b761-44f4-8de2-0ee24a0b1fda)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Creating volume 3b1b0b19-88af-4771-b7f9-8aa1956e258f {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:29:41 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:41 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-a357ccc8-c823-4bfc-a565-30654b68e4b8 tempest-VolumesActionsTest-129238514 None] Deleted volume successfully. Jul 10 00:29:41 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f 1073741824 Jul 10 00:29:41 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a357ccc8-c823-4bfc-a565-30654b68e4b8 tempest-VolumesActionsTest-129238514 None] Lock "cinder-24c56379-dac5-4be5-9d20-99f801292e5d-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:29:41 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Flow 'volume_create_manager' (37ac240f-1729-4cce-90c8-a9ec7099872d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:29:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b04705-4c0c-4278-a36a-f1f4ba4b7297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b04705-4c0c-4278-a36a-f1f4ba4b7297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1516887871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b10fddf-9944-474b-bb4f-0b3b449ac19d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e5287e938b41e9901e0039c8fb3341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:29:42Z,use_quota=True,user_id='55aaf8a6419441b28e7a1ab4b6dd41a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7353583-c8cc-4338-b3d3-0ffd9cdb1735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7353583-c8cc-4338-b3d3-0ffd9cdb1735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80cfa9df-043b-4238-ac94-663a816fbdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80cfa9df-043b-4238-ac94-663a816fbdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b10fddf-9944-474b-bb4f-0b3b449ac19d', 'volume_name': 'volume-7b10fddf-9944-474b-bb4f-0b3b449ac19d', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d577dabf-07c8-4311-bb8f-ccec7eb4b44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d577dabf-07c8-4311-bb8f-ccec7eb4b44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ac07a8-3176-411f-a622-0c266a410946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:42 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Volume 7b10fddf-9944-474b-bb4f-0b3b449ac19d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b10fddf-9944-474b-bb4f-0b3b449ac19d', 'volume_size': 1} Jul 10 00:29:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:42 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-04a58810-6763-4cc1-822a-6389dff7d83b req-b89226b9-6999-419c-af59-f2dc505dde21 tempest-AttachVolumeTestJSON-630674806 None] Terminate volume connection completed successfully. Jul 10 00:29:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-04a58810-6763-4cc1-822a-6389dff7d83b req-b89226b9-6999-419c-af59-f2dc505dde21 tempest-AttachVolumeTestJSON-630674806 None] Deleting attachment 1f3ad8c3-6dd7-430e-be30-bf2fb1b8ed2a. {{(pid=88119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 10 00:29:42 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f 1073741824" returned: 0 in 0.875s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:42 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f Jul 10 00:29:42 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:43 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f" returned: 0 in 0.664s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:29:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.223s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1516887871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b10fddf-9944-474b-bb4f-0b3b449ac19d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e5287e938b41e9901e0039c8fb3341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:29:42Z,use_quota=True,user_id='55aaf8a6419441b28e7a1ab4b6dd41a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:29:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Creating volume 7b10fddf-9944-474b-bb4f-0b3b449ac19d {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:29:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:29:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:29:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:29:43 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:29:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7b10fddf-9944-474b-bb4f-0b3b449ac19d 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2528e07a-564a-4d9f-9f20-338dfad0fd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:43 devstack sudo[96598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7b10fddf-9944-474b-bb4f-0b3b449ac19d 1073741824 Jul 10 00:29:43 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1290aaa-9086-4875-99fd-6528353650c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:43 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Volume volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f (3b1b0b19-88af-4771-b7f9-8aa1956e258f): created successfully Jul 10 00:29:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1290aaa-9086-4875-99fd-6528353650c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Flow 'volume_create_manager' (db6205bc-7ead-47be-b216-6d3382d07a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:29:43 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-31124605-f28a-49a7-a61b-00258e0b63db tempest-GroupSnapshotsTest-103019903 None] Created volume successfully. Jul 10 00:29:44 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-832007d3-6269-475f-8a2c-01bcbef48b39 tempest-GroupSnapshotsTest-103019903 None] GroupSnapshot e864ff2a-d3b6-4e4f-88ab-7440066b8194: creating. Jul 10 00:29:44 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7b10fddf-9944-474b-bb4f-0b3b449ac19d 1073741824" returned: 0 in 0.849s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-832007d3-6269-475f-8a2c-01bcbef48b39 tempest-GroupSnapshotsTest-103019903 None] Group snapshot e864ff2a-d3b6-4e4f-88ab-7440066b8194: creating. {{(pid=88119) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jul 10 00:29:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-832007d3-6269-475f-8a2c-01bcbef48b39 tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7b10fddf-9944-474b-bb4f-0b3b449ac19d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:44 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7b10fddf-9944-474b-bb4f-0b3b449ac19d Jul 10 00:29:44 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:44 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-75f213cd-d51f-475e-ae8a-49363945b8b5 req-1ca92fe5-6b07-4f4d-b68f-dd2fdbb14345 tempest-AttachVolumeTestJSON-630674806 None] Terminate volume connection completed successfully. Jul 10 00:29:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-75f213cd-d51f-475e-ae8a-49363945b8b5 req-1ca92fe5-6b07-4f4d-b68f-dd2fdbb14345 tempest-AttachVolumeTestJSON-630674806 None] Deleting attachment b61311fa-290f-476d-bc21-6c8e03c2cb32. {{(pid=88119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 10 00:29:44 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7b10fddf-9944-474b-bb4f-0b3b449ac19d" returned: 0 in 0.633s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:29:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-832007d3-6269-475f-8a2c-01bcbef48b39 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.651s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-832007d3-6269-475f-8a2c-01bcbef48b39 tempest-GroupSnapshotsTest-103019903 None] Creating offline snapshot 67bda70c-c13b-4039-93c1-ad2b31f40574 of volume 3b1b0b19-88af-4771-b7f9-8aa1956e258f {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:29:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ac07a8-3176-411f-a622-0c266a410946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b10fddf-9944-474b-bb4f-0b3b449ac19d', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcbdd50-326f-43fd-baf8-3723b6dc6bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:44 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13b34dc-1c24-40c0-ac0e-8b4a2749412c]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:29:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-832007d3-6269-475f-8a2c-01bcbef48b39 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:44 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Volume volume-7b10fddf-9944-474b-bb4f-0b3b449ac19d (7b10fddf-9944-474b-bb4f-0b3b449ac19d): created successfully Jul 10 00:29:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcbdd50-326f-43fd-baf8-3723b6dc6bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Flow 'volume_create_manager' (37ac240f-1729-4cce-90c8-a9ec7099872d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:29:44 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-c8be7a90-8c6d-466a-8ac4-c1208f308b84 tempest-VolumesActionsTest-1460527865 None] Created volume successfully. Jul 10 00:29:44 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f Jul 10 00:29:44 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b06c5270-1d0d-44e3-b491-5990e7c7946a tempest-VolumesActionsTest-129238514 None] Acquiring lock "cinder-7b10fddf-9944-474b-bb4f-0b3b449ac19d-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:29:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b06c5270-1d0d-44e3-b491-5990e7c7946a tempest-VolumesActionsTest-129238514 None] Lock "cinder-7b10fddf-9944-474b-bb4f-0b3b449ac19d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:29:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b06c5270-1d0d-44e3-b491-5990e7c7946a tempest-VolumesActionsTest-129238514 None] Acquiring lock "cinder-quobyte-7b10fddf-9944-474b-bb4f-0b3b449ac19d" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:29:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b06c5270-1d0d-44e3-b491-5990e7c7946a tempest-VolumesActionsTest-129238514 None] Lock "cinder-quobyte-7b10fddf-9944-474b-bb4f-0b3b449ac19d" acquired by "delete_volume" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:29:45 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[42aafcaf-c6cb-4066-9b0c-08e9068d6c14]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:29:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b06c5270-1d0d-44e3-b491-5990e7c7946a tempest-VolumesActionsTest-129238514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7b10fddf-9944-474b-bb4f-0b3b449ac19d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:45 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7b10fddf-9944-474b-bb4f-0b3b449ac19d Jul 10 00:29:45 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:45 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-832007d3-6269-475f-8a2c-01bcbef48b39 tempest-GroupSnapshotsTest-103019903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f" returned: 0 in 0.832s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-832007d3-6269-475f-8a2c-01bcbef48b39 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.67bda70c-c13b-4039-93c1-ad2b31f40574 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:45 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.67bda70c-c13b-4039-93c1-ad2b31f40574 1G Jul 10 00:29:45 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:46 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b06c5270-1d0d-44e3-b491-5990e7c7946a tempest-VolumesActionsTest-129238514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7b10fddf-9944-474b-bb4f-0b3b449ac19d" returned: 0 in 0.860s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b06c5270-1d0d-44e3-b491-5990e7c7946a tempest-VolumesActionsTest-129238514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7b10fddf-9944-474b-bb4f-0b3b449ac19d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:46 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7b10fddf-9944-474b-bb4f-0b3b449ac19d Jul 10 00:29:46 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:46 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-832007d3-6269-475f-8a2c-01bcbef48b39 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.67bda70c-c13b-4039-93c1-ad2b31f40574 1G" returned: 0 in 0.945s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-832007d3-6269-475f-8a2c-01bcbef48b39 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.67bda70c-c13b-4039-93c1-ad2b31f40574 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:46 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.67bda70c-c13b-4039-93c1-ad2b31f40574 Jul 10 00:29:46 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:47 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b06c5270-1d0d-44e3-b491-5990e7c7946a tempest-VolumesActionsTest-129238514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7b10fddf-9944-474b-bb4f-0b3b449ac19d" returned: 0 in 0.746s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b06c5270-1d0d-44e3-b491-5990e7c7946a tempest-VolumesActionsTest-129238514 None] Lock "cinder-quobyte-7b10fddf-9944-474b-bb4f-0b3b449ac19d" released by "delete_volume" :: held 1.654s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:29:47 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-b06c5270-1d0d-44e3-b491-5990e7c7946a tempest-VolumesActionsTest-129238514 None] Created reservations ['1c9d80de-5a4b-4461-9dab-3802b771a424', '0883d1d8-8e7d-4286-ad66-60651e25782d', '22d9417f-cc7c-4176-9410-7b8ecc1d01b8', '33a8c8e0-2651-4bbd-8353-8870e606cf81'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:29:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b06c5270-1d0d-44e3-b491-5990e7c7946a tempest-VolumesActionsTest-129238514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b06c5270-1d0d-44e3-b491-5990e7c7946a tempest-VolumesActionsTest-129238514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b06c5270-1d0d-44e3-b491-5990e7c7946a tempest-VolumesActionsTest-129238514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:29:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b06c5270-1d0d-44e3-b491-5990e7c7946a tempest-VolumesActionsTest-129238514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:29:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b06c5270-1d0d-44e3-b491-5990e7c7946a tempest-VolumesActionsTest-129238514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b06c5270-1d0d-44e3-b491-5990e7c7946a tempest-VolumesActionsTest-129238514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:47 devstack sudo[96632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:29:47 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:47 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-832007d3-6269-475f-8a2c-01bcbef48b39 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.67bda70c-c13b-4039-93c1-ad2b31f40574" returned: 0 in 0.820s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:47 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-832007d3-6269-475f-8a2c-01bcbef48b39 tempest-GroupSnapshotsTest-103019903 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.67bda70c-c13b-4039-93c1-ad2b31f40574 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:29:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-832007d3-6269-475f-8a2c-01bcbef48b39 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.67bda70c-c13b-4039-93c1-ad2b31f40574 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:47 devstack sudo[96637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.67bda70c-c13b-4039-93c1-ad2b31f40574 Jul 10 00:29:47 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:48 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b06c5270-1d0d-44e3-b491-5990e7c7946a tempest-VolumesActionsTest-129238514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.857s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:48 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-b06c5270-1d0d-44e3-b491-5990e7c7946a tempest-VolumesActionsTest-129238514 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:29:48 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-b06c5270-1d0d-44e3-b491-5990e7c7946a tempest-VolumesActionsTest-129238514 None] Deleted volume successfully. Jul 10 00:29:48 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b06c5270-1d0d-44e3-b491-5990e7c7946a tempest-VolumesActionsTest-129238514 None] Lock "cinder-7b10fddf-9944-474b-bb4f-0b3b449ac19d-delete_volume" released by "delete_volume" :: held 2.810s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:29:48 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-832007d3-6269-475f-8a2c-01bcbef48b39 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.67bda70c-c13b-4039-93c1-ad2b31f40574" returned: 0 in 0.746s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-832007d3-6269-475f-8a2c-01bcbef48b39 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:48 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.info Jul 10 00:29:48 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:48 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:29:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Flow 'volume_create_manager' (5ffb4fe3-f8b8-4d4a-844b-edd219487b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:29:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (115110f1-ec1a-438a-a761-4a354748922a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (115110f1-ec1a-438a-a761-4a354748922a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-956193260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d094eb-aa7b-4507-8cd3-69913fb28707,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e5287e938b41e9901e0039c8fb3341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:29:48Z,use_quota=True,user_id='55aaf8a6419441b28e7a1ab4b6dd41a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d614b99f-3887-46a7-8439-546cc2aaba68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d614b99f-3887-46a7-8439-546cc2aaba68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4450d7-d4d3-4a9b-bd36-1bccd9c3562c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4450d7-d4d3-4a9b-bd36-1bccd9c3562c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49d094eb-aa7b-4507-8cd3-69913fb28707', 'volume_name': 'volume-49d094eb-aa7b-4507-8cd3-69913fb28707', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5e3a71-e398-4013-883b-d52068ecf83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5e3a71-e398-4013-883b-d52068ecf83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1296ffd3-41d1-4c0d-8554-ee6103ebcaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:48 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Volume 49d094eb-aa7b-4507-8cd3-69913fb28707: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49d094eb-aa7b-4507-8cd3-69913fb28707', 'volume_size': 1} Jul 10 00:29:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:48 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-832007d3-6269-475f-8a2c-01bcbef48b39 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.info" returned: 0 in 0.663s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:48 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-832007d3-6269-475f-8a2c-01bcbef48b39 tempest-GroupSnapshotsTest-103019903 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:29:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-832007d3-6269-475f-8a2c-01bcbef48b39 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:48 devstack sudo[96649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.info Jul 10 00:29:48 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:49 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-832007d3-6269-475f-8a2c-01bcbef48b39 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.info" returned: 0 in 0.797s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-832007d3-6269-475f-8a2c-01bcbef48b39 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.887s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.371s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-956193260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d094eb-aa7b-4507-8cd3-69913fb28707,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e5287e938b41e9901e0039c8fb3341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:29:48Z,use_quota=True,user_id='55aaf8a6419441b28e7a1ab4b6dd41a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:29:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Creating volume 49d094eb-aa7b-4507-8cd3-69913fb28707 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:29:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:29:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:29:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:29:49 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:29:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-49d094eb-aa7b-4507-8cd3-69913fb28707 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:49 devstack sudo[96675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-49d094eb-aa7b-4507-8cd3-69913fb28707 1073741824 Jul 10 00:29:49 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:49 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-832007d3-6269-475f-8a2c-01bcbef48b39 tempest-GroupSnapshotsTest-103019903 None] group_snapshot e864ff2a-d3b6-4e4f-88ab-7440066b8194: created successfully Jul 10 00:29:50 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-49d094eb-aa7b-4507-8cd3-69913fb28707 1073741824" returned: 0 in 0.946s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-49d094eb-aa7b-4507-8cd3-69913fb28707 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:50 devstack sudo[96685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-49d094eb-aa7b-4507-8cd3-69913fb28707 Jul 10 00:29:50 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:51 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Flow 'volume_create_manager' (eb8f0efc-0b45-4aae-a76a-3a0229ff08e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd3542f6-078e-4bf8-959a-7b9cc8ff30b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-49d094eb-aa7b-4507-8cd3-69913fb28707" returned: 0 in 0.723s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd3542f6-078e-4bf8-959a-7b9cc8ff30b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-208243399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=870a44a5-1416-48fb-8f6b-6e8b26b1db55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a13b1b0002a349ffb8c3dfdbb53557d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:29:51Z,use_quota=True,user_id='30dd5e96ae824db59bf3c51da32c254a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9fdc048-072c-48cc-85ff-dcf41f453871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9fdc048-072c-48cc-85ff-dcf41f453871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f880c988-e020-4399-bd52-5e39526d9257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f880c988-e020-4399-bd52-5e39526d9257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '870a44a5-1416-48fb-8f6b-6e8b26b1db55', 'volume_name': 'volume-870a44a5-1416-48fb-8f6b-6e8b26b1db55', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10d482bc-250c-4395-9a52-e1a8e29b7c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10d482bc-250c-4395-9a52-e1a8e29b7c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (224dc44a-b74e-490d-9143-c78397ecd6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:51 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Volume 870a44a5-1416-48fb-8f6b-6e8b26b1db55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-870a44a5-1416-48fb-8f6b-6e8b26b1db55', 'volume_size': 1} Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-208243399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=870a44a5-1416-48fb-8f6b-6e8b26b1db55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a13b1b0002a349ffb8c3dfdbb53557d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:29:51Z,use_quota=True,user_id='30dd5e96ae824db59bf3c51da32c254a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Creating volume 870a44a5-1416-48fb-8f6b-6e8b26b1db55 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:29:51 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-870a44a5-1416-48fb-8f6b-6e8b26b1db55 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1296ffd3-41d1-4c0d-8554-ee6103ebcaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49d094eb-aa7b-4507-8cd3-69913fb28707', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c06469d-ee90-4ab6-907a-ce95fcd111cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:51 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-870a44a5-1416-48fb-8f6b-6e8b26b1db55 1073741824 Jul 10 00:29:51 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:51 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Volume volume-49d094eb-aa7b-4507-8cd3-69913fb28707 (49d094eb-aa7b-4507-8cd3-69913fb28707): created successfully Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c06469d-ee90-4ab6-907a-ce95fcd111cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Flow 'volume_create_manager' (5ffb4fe3-f8b8-4d4a-844b-edd219487b73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:29:51 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-84b5e590-134c-4ea7-9afb-0316c6705240 tempest-VolumesActionsTest-1460527865 None] Created volume successfully. Jul 10 00:29:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:52 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-870a44a5-1416-48fb-8f6b-6e8b26b1db55 1073741824" returned: 0 in 0.914s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-870a44a5-1416-48fb-8f6b-6e8b26b1db55 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:52 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-870a44a5-1416-48fb-8f6b-6e8b26b1db55 Jul 10 00:29:52 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-34b6127b-ab8e-4b2a-a66c-f4c339a72cd2 tempest-VolumesActionsTest-129238514 None] Acquiring lock "cinder-49d094eb-aa7b-4507-8cd3-69913fb28707-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:29:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-34b6127b-ab8e-4b2a-a66c-f4c339a72cd2 tempest-VolumesActionsTest-129238514 None] Lock "cinder-49d094eb-aa7b-4507-8cd3-69913fb28707-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:29:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-34b6127b-ab8e-4b2a-a66c-f4c339a72cd2 tempest-VolumesActionsTest-129238514 None] Acquiring lock "cinder-quobyte-49d094eb-aa7b-4507-8cd3-69913fb28707" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:29:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-34b6127b-ab8e-4b2a-a66c-f4c339a72cd2 tempest-VolumesActionsTest-129238514 None] Lock "cinder-quobyte-49d094eb-aa7b-4507-8cd3-69913fb28707" acquired by "delete_volume" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:29:52 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1cd969-3e08-4a56-8753-ebd909d86075]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:29:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-34b6127b-ab8e-4b2a-a66c-f4c339a72cd2 tempest-VolumesActionsTest-129238514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-49d094eb-aa7b-4507-8cd3-69913fb28707 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:52 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-49d094eb-aa7b-4507-8cd3-69913fb28707 Jul 10 00:29:52 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:53 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-870a44a5-1416-48fb-8f6b-6e8b26b1db55" returned: 0 in 0.662s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.387s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "cinder-quobyte-67bda70c-c13b-4039-93c1-ad2b31f40574-1f1a627f-d1e8-422a-8f35-5ec18f7c110b" by "_create_volume_from_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (224dc44a-b74e-490d-9143-c78397ecd6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-870a44a5-1416-48fb-8f6b-6e8b26b1db55', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ee505c-de20-4142-8cab-28d4d1a77091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-67bda70c-c13b-4039-93c1-ad2b31f40574-1f1a627f-d1e8-422a-8f35-5ec18f7c110b" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Creating volume 1f1a627f-d1e8-422a-8f35-5ec18f7c110b from snapshot 67bda70c-c13b-4039-93c1-ad2b31f40574 {{(pid=88119) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "cinder-quobyte-1f1a627f-d1e8-422a-8f35-5ec18f7c110b" by "_copy_volume_from_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:29:53 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Volume volume-870a44a5-1416-48fb-8f6b-6e8b26b1db55 (870a44a5-1416-48fb-8f6b-6e8b26b1db55): created successfully Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ee505c-de20-4142-8cab-28d4d1a77091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Flow 'volume_create_manager' (eb8f0efc-0b45-4aae-a76a-3a0229ff08e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-1f1a627f-d1e8-422a-8f35-5ec18f7c110b" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] snapshot: 67bda70c-c13b-4039-93c1-ad2b31f40574, volume: 1f1a627f-d1e8-422a-8f35-5ec18f7c110b, {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 00:29:53 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-017bb751-a072-4a1e-922d-24104390d353 tempest-AttachVolumeNegativeTest-1454311424 None] Created volume successfully. Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[82730bc5-aecb-4103-86bc-e5fe95b21128]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.67bda70c-c13b-4039-93c1-ad2b31f40574 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:53 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.67bda70c-c13b-4039-93c1-ad2b31f40574 Jul 10 00:29:53 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:53 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-34b6127b-ab8e-4b2a-a66c-f4c339a72cd2 tempest-VolumesActionsTest-129238514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-49d094eb-aa7b-4507-8cd3-69913fb28707" returned: 0 in 0.817s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-34b6127b-ab8e-4b2a-a66c-f4c339a72cd2 tempest-VolumesActionsTest-129238514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-49d094eb-aa7b-4507-8cd3-69913fb28707 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:53 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-49d094eb-aa7b-4507-8cd3-69913fb28707 Jul 10 00:29:53 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:54 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.67bda70c-c13b-4039-93c1-ad2b31f40574" returned: 0 in 0.805s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:29:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 00:29:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Creating direct copy from snapshot {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 00:29:54 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32c002a-89b8-44ba-99db-c528b0806aef]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:29:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:54 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-34b6127b-ab8e-4b2a-a66c-f4c339a72cd2 tempest-VolumesActionsTest-129238514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-49d094eb-aa7b-4507-8cd3-69913fb28707" returned: 0 in 0.658s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:54 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f Jul 10 00:29:54 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-34b6127b-ab8e-4b2a-a66c-f4c339a72cd2 tempest-VolumesActionsTest-129238514 None] Lock "cinder-quobyte-49d094eb-aa7b-4507-8cd3-69913fb28707" released by "delete_volume" :: held 1.520s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:29:54 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-34b6127b-ab8e-4b2a-a66c-f4c339a72cd2 tempest-VolumesActionsTest-129238514 None] Created reservations ['925c7a4c-bc1a-4b42-9232-82779f1e7f5c', '1982d49c-37cc-457d-873a-28235dc14144', '2710d61b-5895-441b-9fc9-574d1c46ad77', '05906c37-3136-4dfb-b48c-b7786b5450a9'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:29:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-34b6127b-ab8e-4b2a-a66c-f4c339a72cd2 tempest-VolumesActionsTest-129238514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-34b6127b-ab8e-4b2a-a66c-f4c339a72cd2 tempest-VolumesActionsTest-129238514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:29:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-34b6127b-ab8e-4b2a-a66c-f4c339a72cd2 tempest-VolumesActionsTest-129238514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:29:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-34b6127b-ab8e-4b2a-a66c-f4c339a72cd2 tempest-VolumesActionsTest-129238514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:29:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-34b6127b-ab8e-4b2a-a66c-f4c339a72cd2 tempest-VolumesActionsTest-129238514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:29:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-34b6127b-ab8e-4b2a-a66c-f4c339a72cd2 tempest-VolumesActionsTest-129238514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:54 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:29:54 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:54 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f" returned: 0 in 0.821s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:54 devstack cinder-volume[88119]: DEBUG cinder.utils [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Path /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f1a627f-d1e8-422a-8f35-5ec18f7c110b not found in is_blk_device check {{(pid=88119) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 00:29:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f1a627f-d1e8-422a-8f35-5ec18f7c110b {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:54 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f1a627f-d1e8-422a-8f35-5ec18f7c110b Jul 10 00:29:54 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:55 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-34b6127b-ab8e-4b2a-a66c-f4c339a72cd2 tempest-VolumesActionsTest-129238514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.742s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:55 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-34b6127b-ab8e-4b2a-a66c-f4c339a72cd2 tempest-VolumesActionsTest-129238514 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:29:55 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-34b6127b-ab8e-4b2a-a66c-f4c339a72cd2 tempest-VolumesActionsTest-129238514 None] Deleted volume successfully. Jul 10 00:29:55 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-34b6127b-ab8e-4b2a-a66c-f4c339a72cd2 tempest-VolumesActionsTest-129238514 None] Lock "cinder-49d094eb-aa7b-4507-8cd3-69913fb28707-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:29:55 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:29:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Flow 'volume_create_manager' (c988219d-7703-44a3-8966-8484fb7903a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:29:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230c0a09-6f7b-499d-b05a-977ed7b39d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230c0a09-6f7b-499d-b05a-977ed7b39d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-881059018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da02f92c-d8fa-44d1-91d5-ea5fa40bb412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e5287e938b41e9901e0039c8fb3341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:29:55Z,use_quota=True,user_id='55aaf8a6419441b28e7a1ab4b6dd41a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e049870b-c766-40bb-b8f9-306300eeec1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e049870b-c766-40bb-b8f9-306300eeec1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c36b6e-cdc2-47f1-a3a4-034cc34b6bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c36b6e-cdc2-47f1-a3a4-034cc34b6bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da02f92c-d8fa-44d1-91d5-ea5fa40bb412', 'volume_name': 'volume-da02f92c-d8fa-44d1-91d5-ea5fa40bb412', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2faa21bb-a240-4f5d-9634-51b73ec11d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2faa21bb-a240-4f5d-9634-51b73ec11d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:29:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15817462-e0a7-4ee7-89ee-a1c89a220794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:29:55 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Volume da02f92c-d8fa-44d1-91d5-ea5fa40bb412: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da02f92c-d8fa-44d1-91d5-ea5fa40bb412', 'volume_size': 1} Jul 10 00:29:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:55 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-521c47af-3f90-4ed3-9ff0-54a56923ea03 tempest-AttachVolumeTestJSON-630674806 None] Acquiring lock "cinder-3ea8e5cd-6641-4e28-bc60-efb130f2c2be-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:29:55 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-521c47af-3f90-4ed3-9ff0-54a56923ea03 tempest-AttachVolumeTestJSON-630674806 None] Lock "cinder-3ea8e5cd-6641-4e28-bc60-efb130f2c2be-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:29:55 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-521c47af-3f90-4ed3-9ff0-54a56923ea03 tempest-AttachVolumeTestJSON-630674806 None] Acquiring lock "cinder-quobyte-3ea8e5cd-6641-4e28-bc60-efb130f2c2be" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:29:55 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-521c47af-3f90-4ed3-9ff0-54a56923ea03 tempest-AttachVolumeTestJSON-630674806 None] Lock "cinder-quobyte-3ea8e5cd-6641-4e28-bc60-efb130f2c2be" acquired by "delete_volume" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:29:55 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b772c4cf-43fa-4e44-b606-ee6202728574]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:29:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-521c47af-3f90-4ed3-9ff0-54a56923ea03 tempest-AttachVolumeTestJSON-630674806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3ea8e5cd-6641-4e28-bc60-efb130f2c2be {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:56 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3ea8e5cd-6641-4e28-bc60-efb130f2c2be Jul 10 00:29:56 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-7144b8b2-6724-4259-ac27-935c0a8dc762 req-f9d5bbaa-85ba-44b4-948f-5437c3000111 tempest-AttachVolumeNegativeTest-1454311424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:29:57 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-521c47af-3f90-4ed3-9ff0-54a56923ea03 tempest-AttachVolumeTestJSON-630674806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3ea8e5cd-6641-4e28-bc60-efb130f2c2be" returned: 0 in 1.768s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-521c47af-3f90-4ed3-9ff0-54a56923ea03 tempest-AttachVolumeTestJSON-630674806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3ea8e5cd-6641-4e28-bc60-efb130f2c2be {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:29:57 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3ea8e5cd-6641-4e28-bc60-efb130f2c2be Jul 10 00:29:57 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:29:59 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Jul 10 00:29:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-521c47af-3f90-4ed3-9ff0-54a56923ea03 tempest-AttachVolumeTestJSON-630674806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3ea8e5cd-6641-4e28-bc60-efb130f2c2be" returned: 0 in 2.177s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:29:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-521c47af-3f90-4ed3-9ff0-54a56923ea03 tempest-AttachVolumeTestJSON-630674806 None] Lock "cinder-quobyte-3ea8e5cd-6641-4e28-bc60-efb130f2c2be" released by "delete_volume" :: held 4.019s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:00 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-521c47af-3f90-4ed3-9ff0-54a56923ea03 tempest-AttachVolumeTestJSON-630674806 None] Created reservations ['3a952ad8-597a-46a0-93c8-fc53c9c0caf9', '056a2090-c614-4a7c-bd51-6b086eadaba3', '1679299e-00ba-48b1-bce0-7c28c197fc12', 'e465ef32-2ecd-48f6-8a57-0884ec55d6e3'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:30:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-521c47af-3f90-4ed3-9ff0-54a56923ea03 tempest-AttachVolumeTestJSON-630674806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-521c47af-3f90-4ed3-9ff0-54a56923ea03 tempest-AttachVolumeTestJSON-630674806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-521c47af-3f90-4ed3-9ff0-54a56923ea03 tempest-AttachVolumeTestJSON-630674806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:30:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-521c47af-3f90-4ed3-9ff0-54a56923ea03 tempest-AttachVolumeTestJSON-630674806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:30:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-521c47af-3f90-4ed3-9ff0-54a56923ea03 tempest-AttachVolumeTestJSON-630674806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-521c47af-3f90-4ed3-9ff0-54a56923ea03 tempest-AttachVolumeTestJSON-630674806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:00 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:30:00 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:00 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f1a627f-d1e8-422a-8f35-5ec18f7c110b" returned: 0 in 5.351s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:00 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8773824-b7f2-4071-bbf0-248cf37c1bc3]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:00 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f Jul 10 00:30:00 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:00 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-521c47af-3f90-4ed3-9ff0-54a56923ea03 tempest-AttachVolumeTestJSON-630674806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.613s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:00 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-521c47af-3f90-4ed3-9ff0-54a56923ea03 tempest-AttachVolumeTestJSON-630674806 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:30:00 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-521c47af-3f90-4ed3-9ff0-54a56923ea03 tempest-AttachVolumeTestJSON-630674806 None] Deleted volume successfully. Jul 10 00:30:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-521c47af-3f90-4ed3-9ff0-54a56923ea03 tempest-AttachVolumeTestJSON-630674806 None] Lock "cinder-3ea8e5cd-6641-4e28-bc60-efb130f2c2be-delete_volume" released by "delete_volume" :: held 5.066s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:01 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bd8db768-eca8-4799-8d2a-035c558f8836 tempest-AttachVolumeTestJSON-630674806 None] Acquiring lock "cinder-6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:01 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bd8db768-eca8-4799-8d2a-035c558f8836 tempest-AttachVolumeTestJSON-630674806 None] Lock "cinder-6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:01 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bd8db768-eca8-4799-8d2a-035c558f8836 tempest-AttachVolumeTestJSON-630674806 None] Acquiring lock "cinder-quobyte-6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:01 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bd8db768-eca8-4799-8d2a-035c558f8836 tempest-AttachVolumeTestJSON-630674806 None] Lock "cinder-quobyte-6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0" acquired by "delete_volume" :: waited 0.025s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:01 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f" returned: 0 in 0.933s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:01 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Image conversion details: src /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f, size 1024.00 MB, duration 5.35 sec, destination /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f1a627f-d1e8-422a-8f35-5ec18f7c110b {{(pid=88119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:30:01 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Converted 1024.00 MB image at 191.33 MB/s Jul 10 00:30:01 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f1a627f-d1e8-422a-8f35-5ec18f7c110b is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:30:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f1a627f-d1e8-422a-8f35-5ec18f7c110b {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:01 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc99743-0acf-41b4-a59c-8ea80a91d897]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bd8db768-eca8-4799-8d2a-035c558f8836 tempest-AttachVolumeTestJSON-630674806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:01 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f1a627f-d1e8-422a-8f35-5ec18f7c110b Jul 10 00:30:01 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:01 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0 Jul 10 00:30:01 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:01 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f1a627f-d1e8-422a-8f35-5ec18f7c110b" returned: 0 in 0.637s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:01 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-1f1a627f-d1e8-422a-8f35-5ec18f7c110b" released by "_copy_volume_from_snapshot" :: held 8.653s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:01 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-67bda70c-c13b-4039-93c1-ad2b31f40574-1f1a627f-d1e8-422a-8f35-5ec18f7c110b" released by "_create_volume_from_snapshot" :: held 8.705s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.749s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.303s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:01 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-881059018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da02f92c-d8fa-44d1-91d5-ea5fa40bb412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e5287e938b41e9901e0039c8fb3341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:29:55Z,use_quota=True,user_id='55aaf8a6419441b28e7a1ab4b6dd41a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:30:01 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Creating volume da02f92c-d8fa-44d1-91d5-ea5fa40bb412 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:30:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:01 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:30:01 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:30:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:01 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:30:01 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:30:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da02f92c-d8fa-44d1-91d5-ea5fa40bb412 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:01 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da02f92c-d8fa-44d1-91d5-ea5fa40bb412 1073741824 Jul 10 00:30:01 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:02 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-8deefe6d-184a-4a60-90b1-a003d19ccc87 tempest-GroupSnapshotsTest-103019903 None] Create group from source-snapshot-e864ff2a-d3b6-4e4f-88ab-7440066b8194 completed successfully. Jul 10 00:30:02 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bd8db768-eca8-4799-8d2a-035c558f8836 tempest-AttachVolumeTestJSON-630674806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0" returned: 0 in 0.784s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bd8db768-eca8-4799-8d2a-035c558f8836 tempest-AttachVolumeTestJSON-630674806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:02 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0 Jul 10 00:30:02 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:02 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bd8db768-eca8-4799-8d2a-035c558f8836 tempest-AttachVolumeTestJSON-630674806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0" returned: 0 in 0.685s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bd8db768-eca8-4799-8d2a-035c558f8836 tempest-AttachVolumeTestJSON-630674806 None] Lock "cinder-quobyte-6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0" released by "delete_volume" :: held 1.538s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-0bba8f41-e43a-4338-a573-7cbb8d0def2b tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "cinder-quobyte-1f1a627f-d1e8-422a-8f35-5ec18f7c110b" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-0bba8f41-e43a-4338-a573-7cbb8d0def2b tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-1f1a627f-d1e8-422a-8f35-5ec18f7c110b" acquired by "delete_volume" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:02 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da02f92c-d8fa-44d1-91d5-ea5fa40bb412 1073741824" returned: 0 in 0.905s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:02 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbf6983-ded9-4ed8-82fb-e11a0203338a]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0bba8f41-e43a-4338-a573-7cbb8d0def2b tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f1a627f-d1e8-422a-8f35-5ec18f7c110b {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:02 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-bd8db768-eca8-4799-8d2a-035c558f8836 tempest-AttachVolumeTestJSON-630674806 None] Created reservations ['a2f59fe4-7183-40fa-aa02-0ff2bd11d12f', '49d579d6-1c4a-4183-8e38-2ed744cc7e8d', 'e2d2a1df-cb84-46a2-a572-49432314cf35', 'e5059916-4239-4033-a2eb-4fa2e5abdfa2'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:30:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da02f92c-d8fa-44d1-91d5-ea5fa40bb412 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:02 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da02f92c-d8fa-44d1-91d5-ea5fa40bb412 Jul 10 00:30:02 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:02 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f1a627f-d1e8-422a-8f35-5ec18f7c110b Jul 10 00:30:02 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-bd8db768-eca8-4799-8d2a-035c558f8836 tempest-AttachVolumeTestJSON-630674806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-bd8db768-eca8-4799-8d2a-035c558f8836 tempest-AttachVolumeTestJSON-630674806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-bd8db768-eca8-4799-8d2a-035c558f8836 tempest-AttachVolumeTestJSON-630674806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:30:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-bd8db768-eca8-4799-8d2a-035c558f8836 tempest-AttachVolumeTestJSON-630674806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:30:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-bd8db768-eca8-4799-8d2a-035c558f8836 tempest-AttachVolumeTestJSON-630674806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bd8db768-eca8-4799-8d2a-035c558f8836 tempest-AttachVolumeTestJSON-630674806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:02 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:30:02 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:03 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-57bd063f-5ced-4bbc-af23-65bc4c085bbb tempest-AttachVolumeTestJSON-630674806 None] Acquiring lock "cinder-5d219371-b700-4022-8dd1-7491466e16c2-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:03 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-57bd063f-5ced-4bbc-af23-65bc4c085bbb tempest-AttachVolumeTestJSON-630674806 None] Lock "cinder-5d219371-b700-4022-8dd1-7491466e16c2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:03 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-57bd063f-5ced-4bbc-af23-65bc4c085bbb tempest-AttachVolumeTestJSON-630674806 None] Acquiring lock "cinder-quobyte-5d219371-b700-4022-8dd1-7491466e16c2" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:03 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-57bd063f-5ced-4bbc-af23-65bc4c085bbb tempest-AttachVolumeTestJSON-630674806 None] Lock "cinder-quobyte-5d219371-b700-4022-8dd1-7491466e16c2" acquired by "delete_volume" :: waited 0.027s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:03 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da02f92c-d8fa-44d1-91d5-ea5fa40bb412" returned: 0 in 0.783s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:30:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:03 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[665c06d7-1f84-4211-bffe-aaf1ac78e645]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-7144b8b2-6724-4259-ac27-935c0a8dc762 req-f9d5bbaa-85ba-44b4-948f-5437c3000111 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.407s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:03 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-57bd063f-5ced-4bbc-af23-65bc4c085bbb tempest-AttachVolumeTestJSON-630674806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d219371-b700-4022-8dd1-7491466e16c2 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0bba8f41-e43a-4338-a573-7cbb8d0def2b tempest-GroupSnapshotsTest-103019903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f1a627f-d1e8-422a-8f35-5ec18f7c110b" returned: 0 in 0.888s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0bba8f41-e43a-4338-a573-7cbb8d0def2b tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f1a627f-d1e8-422a-8f35-5ec18f7c110b {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:03 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:03 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b1449a-c4d9-41e8-bb78-808e620adc92]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15817462-e0a7-4ee7-89ee-a1c89a220794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da02f92c-d8fa-44d1-91d5-ea5fa40bb412', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ec2804-4923-434f-b689-649896ab6fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:03 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f1a627f-d1e8-422a-8f35-5ec18f7c110b Jul 10 00:30:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-7144b8b2-6724-4259-ac27-935c0a8dc762 req-f9d5bbaa-85ba-44b4-948f-5437c3000111 tempest-AttachVolumeNegativeTest-1454311424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-870a44a5-1416-48fb-8f6b-6e8b26b1db55 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:03 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bd8db768-eca8-4799-8d2a-035c558f8836 tempest-AttachVolumeTestJSON-630674806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.803s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:03 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-bd8db768-eca8-4799-8d2a-035c558f8836 tempest-AttachVolumeTestJSON-630674806 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:30:03 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Volume volume-da02f92c-d8fa-44d1-91d5-ea5fa40bb412 (da02f92c-d8fa-44d1-91d5-ea5fa40bb412): created successfully Jul 10 00:30:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ec2804-4923-434f-b689-649896ab6fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Flow 'volume_create_manager' (c988219d-7703-44a3-8966-8484fb7903a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:30:03 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-bd8db768-eca8-4799-8d2a-035c558f8836 tempest-AttachVolumeTestJSON-630674806 None] Deleted volume successfully. Jul 10 00:30:03 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-76ff50ff-8fd5-4428-9a43-44782e7c9afc tempest-VolumesActionsTest-1460527865 None] Created volume successfully. Jul 10 00:30:03 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bd8db768-eca8-4799-8d2a-035c558f8836 tempest-AttachVolumeTestJSON-630674806 None] Lock "cinder-6c2d8022-9e5d-4ef2-9c59-8b85085b6bc0-delete_volume" released by "delete_volume" :: held 2.678s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:03 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d219371-b700-4022-8dd1-7491466e16c2 Jul 10 00:30:03 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:03 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-870a44a5-1416-48fb-8f6b-6e8b26b1db55 Jul 10 00:30:03 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:04 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0bba8f41-e43a-4338-a573-7cbb8d0def2b tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f1a627f-d1e8-422a-8f35-5ec18f7c110b" returned: 0 in 0.671s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-0bba8f41-e43a-4338-a573-7cbb8d0def2b tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-1f1a627f-d1e8-422a-8f35-5ec18f7c110b" released by "delete_volume" :: held 1.615s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:04 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-0bba8f41-e43a-4338-a573-7cbb8d0def2b tempest-GroupSnapshotsTest-103019903 None] Created reservations ['40a41f10-2892-4ff6-87e9-4dca795c2fa8'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:30:04 devstack cinder-volume[88119]: WARNING cinder.quota [None req-0bba8f41-e43a-4338-a573-7cbb8d0def2b tempest-GroupSnapshotsTest-103019903 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-244024788 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-244024788, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:30:04 devstack cinder-volume[88119]: WARNING cinder.quota [None req-0bba8f41-e43a-4338-a573-7cbb8d0def2b tempest-GroupSnapshotsTest-103019903 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-244024788 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-244024788, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:30:04 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-0bba8f41-e43a-4338-a573-7cbb8d0def2b tempest-GroupSnapshotsTest-103019903 None] Created reservations ['d00b92c0-1396-4235-8fb9-eb3772040cd8', '2254f12e-e27e-4500-b613-fe8465aaeeae', 'd67215a5-c110-483f-a56c-10cb746d9ff9', '07eca936-1df6-4497-90da-e1d09980f762'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:30:04 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-57bd063f-5ced-4bbc-af23-65bc4c085bbb tempest-AttachVolumeTestJSON-630674806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d219371-b700-4022-8dd1-7491466e16c2" returned: 0 in 0.888s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-57bd063f-5ced-4bbc-af23-65bc4c085bbb tempest-AttachVolumeTestJSON-630674806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d219371-b700-4022-8dd1-7491466e16c2 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:04 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-7144b8b2-6724-4259-ac27-935c0a8dc762 req-f9d5bbaa-85ba-44b4-948f-5437c3000111 tempest-AttachVolumeNegativeTest-1454311424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-870a44a5-1416-48fb-8f6b-6e8b26b1db55" returned: 0 in 0.857s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-7144b8b2-6724-4259-ac27-935c0a8dc762 req-f9d5bbaa-85ba-44b4-948f-5437c3000111 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.917s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:04 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d219371-b700-4022-8dd1-7491466e16c2 Jul 10 00:30:04 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0bba8f41-e43a-4338-a573-7cbb8d0def2b tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0bba8f41-e43a-4338-a573-7cbb8d0def2b tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:04 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0bba8f41-e43a-4338-a573-7cbb8d0def2b tempest-GroupSnapshotsTest-103019903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:30:04 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0bba8f41-e43a-4338-a573-7cbb8d0def2b tempest-GroupSnapshotsTest-103019903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:30:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0bba8f41-e43a-4338-a573-7cbb8d0def2b tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0bba8f41-e43a-4338-a573-7cbb8d0def2b tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:04 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:30:04 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-7144b8b2-6724-4259-ac27-935c0a8dc762 req-f9d5bbaa-85ba-44b4-948f-5437c3000111 tempest-AttachVolumeNegativeTest-1454311424 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff', 'name': 'volume-870a44a5-1416-48fb-8f6b-6e8b26b1db55', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9aeb3e88-040b-4753-8751-b80e6cb2c7db', 'enforce_multipath': True} {{(pid=88119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 10 00:30:04 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-7144b8b2-6724-4259-ac27-935c0a8dc762 req-f9d5bbaa-85ba-44b4-948f-5437c3000111 tempest-AttachVolumeNegativeTest-1454311424 None] attachment_update completed successfully. Jul 10 00:30:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bc0c421f-82f7-4abe-a4d3-f441a6883719 tempest-VolumesActionsTest-129238514 None] Acquiring lock "cinder-da02f92c-d8fa-44d1-91d5-ea5fa40bb412-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bc0c421f-82f7-4abe-a4d3-f441a6883719 tempest-VolumesActionsTest-129238514 None] Lock "cinder-da02f92c-d8fa-44d1-91d5-ea5fa40bb412-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:05 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-57bd063f-5ced-4bbc-af23-65bc4c085bbb tempest-AttachVolumeTestJSON-630674806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d219371-b700-4022-8dd1-7491466e16c2" returned: 0 in 0.708s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bc0c421f-82f7-4abe-a4d3-f441a6883719 tempest-VolumesActionsTest-129238514 None] Acquiring lock "cinder-quobyte-da02f92c-d8fa-44d1-91d5-ea5fa40bb412" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-57bd063f-5ced-4bbc-af23-65bc4c085bbb tempest-AttachVolumeTestJSON-630674806 None] Lock "cinder-quobyte-5d219371-b700-4022-8dd1-7491466e16c2" released by "delete_volume" :: held 1.683s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bc0c421f-82f7-4abe-a4d3-f441a6883719 tempest-VolumesActionsTest-129238514 None] Lock "cinder-quobyte-da02f92c-d8fa-44d1-91d5-ea5fa40bb412" acquired by "delete_volume" :: waited 0.044s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:05 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-2f35bf43-7c3f-4fd5-a52d-0ba888c8fdb9 tempest-GroupSnapshotsTest-103019903 None] group_snapshot e864ff2a-d3b6-4e4f-88ab-7440066b8194: deleting Jul 10 00:30:05 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[53af41b2-5d55-481b-b473-f78dc86ecd10]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bc0c421f-82f7-4abe-a4d3-f441a6883719 tempest-VolumesActionsTest-129238514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da02f92c-d8fa-44d1-91d5-ea5fa40bb412 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:05 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2f35bf43-7c3f-4fd5-a52d-0ba888c8fdb9 tempest-GroupSnapshotsTest-103019903 None] group_snapshot e864ff2a-d3b6-4e4f-88ab-7440066b8194: deleting {{(pid=88119) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jul 10 00:30:05 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-57bd063f-5ced-4bbc-af23-65bc4c085bbb tempest-AttachVolumeTestJSON-630674806 None] Created reservations ['5d8b5445-36d7-43f5-943c-cbc5f809f34c', '9339e24c-38ed-4325-be92-b61402751d04', '69fd142c-c51b-4227-9909-e5217ed02dfe', '40fccc3d-5fdb-4bbf-ab80-0e9da40d5454'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:30:05 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0bba8f41-e43a-4338-a573-7cbb8d0def2b tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.860s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:05 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-0bba8f41-e43a-4338-a573-7cbb8d0def2b tempest-GroupSnapshotsTest-103019903 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:30:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2f35bf43-7c3f-4fd5-a52d-0ba888c8fdb9 tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "cinder-quobyte-3b1b0b19-88af-4771-b7f9-8aa1956e258f" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:05 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-0bba8f41-e43a-4338-a573-7cbb8d0def2b tempest-GroupSnapshotsTest-103019903 None] Delete group completed successfully. Jul 10 00:30:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2f35bf43-7c3f-4fd5-a52d-0ba888c8fdb9 tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-3b1b0b19-88af-4771-b7f9-8aa1956e258f" acquired by "delete_snapshot" :: waited 0.053s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2f35bf43-7c3f-4fd5-a52d-0ba888c8fdb9 tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "cinder-quobyte-67bda70c-c13b-4039-93c1-ad2b31f40574" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:05 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da02f92c-d8fa-44d1-91d5-ea5fa40bb412 Jul 10 00:30:05 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2f35bf43-7c3f-4fd5-a52d-0ba888c8fdb9 tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-67bda70c-c13b-4039-93c1-ad2b31f40574" acquired by "_delete_snapshot" :: waited 0.066s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-2f35bf43-7c3f-4fd5-a52d-0ba888c8fdb9 tempest-GroupSnapshotsTest-103019903 None] Deleting offline snapshot 67bda70c-c13b-4039-93c1-ad2b31f40574 of volume 3b1b0b19-88af-4771-b7f9-8aa1956e258f {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:30:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-2f35bf43-7c3f-4fd5-a52d-0ba888c8fdb9 tempest-GroupSnapshotsTest-103019903 None] snapshot_file for this snap is: volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.67bda70c-c13b-4039-93c1-ad2b31f40574 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:30:05 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1235ead3-bf50-4241-b514-a91c4dbf5707]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2f35bf43-7c3f-4fd5-a52d-0ba888c8fdb9 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.67bda70c-c13b-4039-93c1-ad2b31f40574 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-57bd063f-5ced-4bbc-af23-65bc4c085bbb tempest-AttachVolumeTestJSON-630674806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-57bd063f-5ced-4bbc-af23-65bc4c085bbb tempest-AttachVolumeTestJSON-630674806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-57bd063f-5ced-4bbc-af23-65bc4c085bbb tempest-AttachVolumeTestJSON-630674806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:30:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-57bd063f-5ced-4bbc-af23-65bc4c085bbb tempest-AttachVolumeTestJSON-630674806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:30:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-57bd063f-5ced-4bbc-af23-65bc4c085bbb tempest-AttachVolumeTestJSON-630674806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-57bd063f-5ced-4bbc-af23-65bc4c085bbb tempest-AttachVolumeTestJSON-630674806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:05 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:30:05 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:05 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.67bda70c-c13b-4039-93c1-ad2b31f40574 Jul 10 00:30:05 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:06 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bc0c421f-82f7-4abe-a4d3-f441a6883719 tempest-VolumesActionsTest-129238514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da02f92c-d8fa-44d1-91d5-ea5fa40bb412" returned: 0 in 1.043s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bc0c421f-82f7-4abe-a4d3-f441a6883719 tempest-VolumesActionsTest-129238514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da02f92c-d8fa-44d1-91d5-ea5fa40bb412 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:06 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da02f92c-d8fa-44d1-91d5-ea5fa40bb412 Jul 10 00:30:06 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:06 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-57bd063f-5ced-4bbc-af23-65bc4c085bbb tempest-AttachVolumeTestJSON-630674806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.910s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:06 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-57bd063f-5ced-4bbc-af23-65bc4c085bbb tempest-AttachVolumeTestJSON-630674806 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:30:06 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2f35bf43-7c3f-4fd5-a52d-0ba888c8fdb9 tempest-GroupSnapshotsTest-103019903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.67bda70c-c13b-4039-93c1-ad2b31f40574" returned: 0 in 0.967s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:06 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-2f35bf43-7c3f-4fd5-a52d-0ba888c8fdb9 tempest-GroupSnapshotsTest-103019903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:30:06 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-57bd063f-5ced-4bbc-af23-65bc4c085bbb tempest-AttachVolumeTestJSON-630674806 None] Deleted volume successfully. Jul 10 00:30:06 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4e91b8-2ae6-40cd-8d5d-2420f216279c]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2f35bf43-7c3f-4fd5-a52d-0ba888c8fdb9 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:06 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-57bd063f-5ced-4bbc-af23-65bc4c085bbb tempest-AttachVolumeTestJSON-630674806 None] Lock "cinder-5d219371-b700-4022-8dd1-7491466e16c2-delete_volume" released by "delete_volume" :: held 3.204s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:06 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f Jul 10 00:30:06 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:07 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bc0c421f-82f7-4abe-a4d3-f441a6883719 tempest-VolumesActionsTest-129238514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da02f92c-d8fa-44d1-91d5-ea5fa40bb412" returned: 0 in 0.857s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bc0c421f-82f7-4abe-a4d3-f441a6883719 tempest-VolumesActionsTest-129238514 None] Lock "cinder-quobyte-da02f92c-d8fa-44d1-91d5-ea5fa40bb412" released by "delete_volume" :: held 1.968s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:07 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=112,cinder:INSERT=25,cinder:UPDATE=103,cinder:DELETE=10 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:30:07 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:UPDATE=128,cinder:DELETE=7,cinder:SELECT=105,cinder:INSERT=24 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:30:07 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-bc0c421f-82f7-4abe-a4d3-f441a6883719 tempest-VolumesActionsTest-129238514 None] Created reservations ['286ae4af-861b-44fe-925d-daba5b3299cc', 'c15f2f52-f11d-46de-8bcc-282b9b3e52ae', '312954f4-182f-4063-adbf-521fdcde9969', '18f4875b-025e-45ec-a20a-9f45931b9bd2'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:30:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-bc0c421f-82f7-4abe-a4d3-f441a6883719 tempest-VolumesActionsTest-129238514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-bc0c421f-82f7-4abe-a4d3-f441a6883719 tempest-VolumesActionsTest-129238514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-bc0c421f-82f7-4abe-a4d3-f441a6883719 tempest-VolumesActionsTest-129238514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:30:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-bc0c421f-82f7-4abe-a4d3-f441a6883719 tempest-VolumesActionsTest-129238514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:30:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-bc0c421f-82f7-4abe-a4d3-f441a6883719 tempest-VolumesActionsTest-129238514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bc0c421f-82f7-4abe-a4d3-f441a6883719 tempest-VolumesActionsTest-129238514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:07 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:30:07 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:07 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2f35bf43-7c3f-4fd5-a52d-0ba888c8fdb9 tempest-GroupSnapshotsTest-103019903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f" returned: 0 in 0.927s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2f35bf43-7c3f-4fd5-a52d-0ba888c8fdb9 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.67bda70c-c13b-4039-93c1-ad2b31f40574 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:07 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.67bda70c-c13b-4039-93c1-ad2b31f40574 Jul 10 00:30:07 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:08 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Flow 'volume_create_manager' (41c93c4e-765d-4300-83d4-528653f24db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf80dba-399f-4225-a68d-bdb3343ba251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bc0c421f-82f7-4abe-a4d3-f441a6883719 tempest-VolumesActionsTest-129238514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.926s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-bc0c421f-82f7-4abe-a4d3-f441a6883719 tempest-VolumesActionsTest-129238514 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:30:08 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-bc0c421f-82f7-4abe-a4d3-f441a6883719 tempest-VolumesActionsTest-129238514 None] Deleted volume successfully. Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf80dba-399f-4225-a68d-bdb3343ba251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1873611080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=291acc1c-5c64-4bd2-81e8-d56bb0e82c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e5287e938b41e9901e0039c8fb3341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:30:08Z,use_quota=True,user_id='55aaf8a6419441b28e7a1ab4b6dd41a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293f073a-089b-4078-bed6-316aae2c3496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293f073a-089b-4078-bed6-316aae2c3496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e7a8861-f983-494a-b3e7-30ac370a3487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e7a8861-f983-494a-b3e7-30ac370a3487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '291acc1c-5c64-4bd2-81e8-d56bb0e82c5a', 'volume_name': 'volume-291acc1c-5c64-4bd2-81e8-d56bb0e82c5a', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b11f16-0fd8-4954-b8e7-2f6c39043777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b11f16-0fd8-4954-b8e7-2f6c39043777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7043b80a-4cde-4f35-9975-d7ab5e37bce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:08 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Volume 291acc1c-5c64-4bd2-81e8-d56bb0e82c5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-291acc1c-5c64-4bd2-81e8-d56bb0e82c5a', 'volume_size': 1} Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1873611080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=291acc1c-5c64-4bd2-81e8-d56bb0e82c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e5287e938b41e9901e0039c8fb3341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:30:08Z,use_quota=True,user_id='55aaf8a6419441b28e7a1ab4b6dd41a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Creating volume 291acc1c-5c64-4bd2-81e8-d56bb0e82c5a {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:30:08 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-291acc1c-5c64-4bd2-81e8-d56bb0e82c5a 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bc0c421f-82f7-4abe-a4d3-f441a6883719 tempest-VolumesActionsTest-129238514 None] Lock "cinder-da02f92c-d8fa-44d1-91d5-ea5fa40bb412-delete_volume" released by "delete_volume" :: held 3.268s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:08 devstack sudo[97241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-291acc1c-5c64-4bd2-81e8-d56bb0e82c5a 1073741824 Jul 10 00:30:08 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:08 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2f35bf43-7c3f-4fd5-a52d-0ba888c8fdb9 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.67bda70c-c13b-4039-93c1-ad2b31f40574" returned: 0 in 0.997s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2f35bf43-7c3f-4fd5-a52d-0ba888c8fdb9 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.67bda70c-c13b-4039-93c1-ad2b31f40574 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:08 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.67bda70c-c13b-4039-93c1-ad2b31f40574 Jul 10 00:30:08 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:09 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2f35bf43-7c3f-4fd5-a52d-0ba888c8fdb9 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f.67bda70c-c13b-4039-93c1-ad2b31f40574" returned: 0 in 0.838s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:09 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2f35bf43-7c3f-4fd5-a52d-0ba888c8fdb9 tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-67bda70c-c13b-4039-93c1-ad2b31f40574" released by "_delete_snapshot" :: held 3.873s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:09 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2f35bf43-7c3f-4fd5-a52d-0ba888c8fdb9 tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-3b1b0b19-88af-4771-b7f9-8aa1956e258f" released by "delete_snapshot" :: held 3.964s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:09 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-291acc1c-5c64-4bd2-81e8-d56bb0e82c5a 1073741824" returned: 0 in 1.100s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-291acc1c-5c64-4bd2-81e8-d56bb0e82c5a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:09 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-291acc1c-5c64-4bd2-81e8-d56bb0e82c5a Jul 10 00:30:09 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:09 devstack cinder-volume[88119]: WARNING cinder.quota [None req-2f35bf43-7c3f-4fd5-a52d-0ba888c8fdb9 tempest-GroupSnapshotsTest-103019903 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-244024788 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-244024788, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:30:09 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-2f35bf43-7c3f-4fd5-a52d-0ba888c8fdb9 tempest-GroupSnapshotsTest-103019903 None] Created reservations ['79ec60fc-3779-490e-b477-613ca2113637', 'e3138686-2d74-4513-9609-5a950cf439ef', '41a173cd-a272-40d1-88f5-4fd4fd8b0499', '8cf6d921-f1f3-4d6a-aa30-5346add30599'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:30:09 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-2f35bf43-7c3f-4fd5-a52d-0ba888c8fdb9 tempest-GroupSnapshotsTest-103019903 None] group_snapshot e864ff2a-d3b6-4e4f-88ab-7440066b8194: deleted successfully Jul 10 00:30:10 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-291acc1c-5c64-4bd2-81e8-d56bb0e82c5a" returned: 0 in 0.919s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:10 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] <== create_volume: return (2094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:30:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.098s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:10 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7043b80a-4cde-4f35-9975-d7ab5e37bce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-291acc1c-5c64-4bd2-81e8-d56bb0e82c5a', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:10 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17d319e9-1628-46cf-a46e-e2ac0d81a42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:10 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Volume volume-291acc1c-5c64-4bd2-81e8-d56bb0e82c5a (291acc1c-5c64-4bd2-81e8-d56bb0e82c5a): created successfully Jul 10 00:30:10 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17d319e9-1628-46cf-a46e-e2ac0d81a42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:10 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Flow 'volume_create_manager' (41c93c4e-765d-4300-83d4-528653f24db8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:30:10 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-618e49d9-228f-4380-8ad6-37af26169763 tempest-VolumesActionsTest-1460527865 None] Created volume successfully. Jul 10 00:30:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-4a1008e9-4779-4137-a585-7eeeedc518c2 tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "cinder-quobyte-3b1b0b19-88af-4771-b7f9-8aa1956e258f" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-4a1008e9-4779-4137-a585-7eeeedc518c2 tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-3b1b0b19-88af-4771-b7f9-8aa1956e258f" acquired by "delete_volume" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:11 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d601e61-f9fc-4137-81f7-9246f1673769]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4a1008e9-4779-4137-a585-7eeeedc518c2 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:11 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-cdeeab3c-a799-4faf-beeb-52b2486afa9c req-b78aca6c-02db-44cc-9e50-0c6e382989b8 tempest-AttachVolumeNegativeTest-1454311424 None] Terminate volume connection completed successfully. Jul 10 00:30:11 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-cdeeab3c-a799-4faf-beeb-52b2486afa9c req-b78aca6c-02db-44cc-9e50-0c6e382989b8 tempest-AttachVolumeNegativeTest-1454311424 None] Deleting attachment 9aeb3e88-040b-4753-8751-b80e6cb2c7db. {{(pid=88119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 10 00:30:11 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f Jul 10 00:30:11 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:12 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4a1008e9-4779-4137-a585-7eeeedc518c2 tempest-GroupSnapshotsTest-103019903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f" returned: 0 in 0.862s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4a1008e9-4779-4137-a585-7eeeedc518c2 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:12 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f Jul 10 00:30:12 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:12 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fa126ba0-4583-45cb-b205-d2d0314aa591 tempest-VolumesActionsTest-1460527865 None] Acquiring lock "cinder-291acc1c-5c64-4bd2-81e8-d56bb0e82c5a-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:12 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fa126ba0-4583-45cb-b205-d2d0314aa591 tempest-VolumesActionsTest-1460527865 None] Lock "cinder-291acc1c-5c64-4bd2-81e8-d56bb0e82c5a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:12 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fa126ba0-4583-45cb-b205-d2d0314aa591 tempest-VolumesActionsTest-1460527865 None] Acquiring lock "cinder-quobyte-291acc1c-5c64-4bd2-81e8-d56bb0e82c5a" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:12 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fa126ba0-4583-45cb-b205-d2d0314aa591 tempest-VolumesActionsTest-1460527865 None] Lock "cinder-quobyte-291acc1c-5c64-4bd2-81e8-d56bb0e82c5a" acquired by "delete_volume" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:12 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[247c55f9-38ed-4e30-9f23-db765360b0e0]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fa126ba0-4583-45cb-b205-d2d0314aa591 tempest-VolumesActionsTest-1460527865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-291acc1c-5c64-4bd2-81e8-d56bb0e82c5a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:12 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-291acc1c-5c64-4bd2-81e8-d56bb0e82c5a Jul 10 00:30:12 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:12 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4a1008e9-4779-4137-a585-7eeeedc518c2 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3b1b0b19-88af-4771-b7f9-8aa1956e258f" returned: 0 in 0.772s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:13 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-4a1008e9-4779-4137-a585-7eeeedc518c2 tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-3b1b0b19-88af-4771-b7f9-8aa1956e258f" released by "delete_volume" :: held 1.715s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:13 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-4a1008e9-4779-4137-a585-7eeeedc518c2 tempest-GroupSnapshotsTest-103019903 None] Created reservations ['ec06c9ca-9aeb-448c-8d91-a7fb2f6dae60'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:30:13 devstack cinder-volume[88119]: WARNING cinder.db.api [None req-4a1008e9-4779-4137-a585-7eeeedc518c2 tempest-GroupSnapshotsTest-103019903 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-244024788'] Jul 10 00:30:13 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-4a1008e9-4779-4137-a585-7eeeedc518c2 tempest-GroupSnapshotsTest-103019903 None] Created reservations ['b1172981-26a0-4f93-b39a-bbc2680619d6', '5f848b85-ac69-4fa0-a563-eb8388a8cef8', '09e1e949-d625-49a2-a1ec-a06d08cd589f', '1db18a07-17ad-4797-a7a9-9ba7b9bbe871'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:30:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4a1008e9-4779-4137-a585-7eeeedc518c2 tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4a1008e9-4779-4137-a585-7eeeedc518c2 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4a1008e9-4779-4137-a585-7eeeedc518c2 tempest-GroupSnapshotsTest-103019903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:30:13 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4a1008e9-4779-4137-a585-7eeeedc518c2 tempest-GroupSnapshotsTest-103019903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:30:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4a1008e9-4779-4137-a585-7eeeedc518c2 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4a1008e9-4779-4137-a585-7eeeedc518c2 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fa126ba0-4583-45cb-b205-d2d0314aa591 tempest-VolumesActionsTest-1460527865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-291acc1c-5c64-4bd2-81e8-d56bb0e82c5a" returned: 0 in 0.844s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fa126ba0-4583-45cb-b205-d2d0314aa591 tempest-VolumesActionsTest-1460527865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-291acc1c-5c64-4bd2-81e8-d56bb0e82c5a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:13 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:30:13 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:13 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-291acc1c-5c64-4bd2-81e8-d56bb0e82c5a Jul 10 00:30:13 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:30:14 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Flow 'volume_create_manager' (4342a915-94b6-463e-918a-6b5ba9f7651c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:30:14 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b047aa-fa22-4e86-81d5-8591bb68fc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4a1008e9-4779-4137-a585-7eeeedc518c2 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.033s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fa126ba0-4583-45cb-b205-d2d0314aa591 tempest-VolumesActionsTest-1460527865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-291acc1c-5c64-4bd2-81e8-d56bb0e82c5a" returned: 0 in 1.022s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-4a1008e9-4779-4137-a585-7eeeedc518c2 tempest-GroupSnapshotsTest-103019903 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b047aa-fa22-4e86-81d5-8591bb68fc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2121140348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de364477-e75b-4612-a3ac-2af7aadf4416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd34c93352014d8e92a8141ec149e089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:30:14Z,use_quota=True,user_id='3641102c63e94f8a86ed151404fef5b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a8a7363-80e7-4485-a7ba-8b9047506ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a8a7363-80e7-4485-a7ba-8b9047506ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc6fcc7-0e6e-4600-8d7c-06c40bfb3f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dc6fcc7-0e6e-4600-8d7c-06c40bfb3f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de364477-e75b-4612-a3ac-2af7aadf4416', 'volume_name': 'volume-de364477-e75b-4612-a3ac-2af7aadf4416', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb38472-2468-41f5-85c7-39c358416d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bb38472-2468-41f5-85c7-39c358416d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6d4bd9-2b29-4187-bf72-adee551bcfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:14 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Volume de364477-e75b-4612-a3ac-2af7aadf4416: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de364477-e75b-4612-a3ac-2af7aadf4416', 'volume_size': 1} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:30:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2121140348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de364477-e75b-4612-a3ac-2af7aadf4416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd34c93352014d8e92a8141ec149e089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:30:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:30:14Z,use_quota=True,user_id='3641102c63e94f8a86ed151404fef5b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Creating volume de364477-e75b-4612-a3ac-2af7aadf4416 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:30:14 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fa126ba0-4583-45cb-b205-d2d0314aa591 tempest-VolumesActionsTest-1460527865 None] Lock "cinder-quobyte-291acc1c-5c64-4bd2-81e8-d56bb0e82c5a" released by "delete_volume" :: held 2.005s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:14 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-4a1008e9-4779-4137-a585-7eeeedc518c2 tempest-GroupSnapshotsTest-103019903 None] Delete group completed successfully. Jul 10 00:30:14 devstack sudo[97307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416 1073741824 Jul 10 00:30:14 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:14 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-6d3cd21a-fc0b-42c6-a9a9-d87686bf86aa tempest-GroupSnapshotsTest-103019903 None] Group tempest-GroupSnapshotsTest-Group-344225631: creating Jul 10 00:30:14 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-6d3cd21a-fc0b-42c6-a9a9-d87686bf86aa tempest-GroupSnapshotsTest-103019903 None] Group tempest-GroupSnapshotsTest-Group-344225631: created successfully Jul 10 00:30:14 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-6d3cd21a-fc0b-42c6-a9a9-d87686bf86aa tempest-GroupSnapshotsTest-103019903 None] Create group completed successfully. Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-fa126ba0-4583-45cb-b205-d2d0314aa591 tempest-VolumesActionsTest-1460527865 None] Created reservations ['92fdffa5-4b53-4d25-9fa4-2b9517e749c7', '5fe088b1-c709-4072-a124-077d1f5ac44a', '62d85361-c0ca-48e8-ac35-e461cb5ff0f5', '1dfefb73-d9f2-49fb-975a-bc420bdd2f9d'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-fa126ba0-4583-45cb-b205-d2d0314aa591 tempest-VolumesActionsTest-1460527865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-fa126ba0-4583-45cb-b205-d2d0314aa591 tempest-VolumesActionsTest-1460527865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-fa126ba0-4583-45cb-b205-d2d0314aa591 tempest-VolumesActionsTest-1460527865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-fa126ba0-4583-45cb-b205-d2d0314aa591 tempest-VolumesActionsTest-1460527865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-fa126ba0-4583-45cb-b205-d2d0314aa591 tempest-VolumesActionsTest-1460527865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fa126ba0-4583-45cb-b205-d2d0314aa591 tempest-VolumesActionsTest-1460527865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:14 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:30:14 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:15 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fa126ba0-4583-45cb-b205-d2d0314aa591 tempest-VolumesActionsTest-1460527865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.718s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:15 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-fa126ba0-4583-45cb-b205-d2d0314aa591 tempest-VolumesActionsTest-1460527865 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:30:15 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-fa126ba0-4583-45cb-b205-d2d0314aa591 tempest-VolumesActionsTest-1460527865 None] Deleted volume successfully. Jul 10 00:30:15 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416 1073741824" returned: 0 in 0.909s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fa126ba0-4583-45cb-b205-d2d0314aa591 tempest-VolumesActionsTest-1460527865 None] Lock "cinder-291acc1c-5c64-4bd2-81e8-d56bb0e82c5a-delete_volume" released by "delete_volume" :: held 2.981s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:15 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416 Jul 10 00:30:15 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:16 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416" returned: 0 in 1.124s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.090s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6d4bd9-2b29-4187-bf72-adee551bcfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de364477-e75b-4612-a3ac-2af7aadf4416', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5caebf0a-8684-4b99-baec-23e4e700705b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Flow 'volume_create_manager' (edf029cc-bb67-4bfd-878b-f631ed2fa60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d31403-5109-4b2d-9554-44e08b55e6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:16 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Volume volume-de364477-e75b-4612-a3ac-2af7aadf4416 (de364477-e75b-4612-a3ac-2af7aadf4416): created successfully Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5caebf0a-8684-4b99-baec-23e4e700705b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Flow 'volume_create_manager' (4342a915-94b6-463e-918a-6b5ba9f7651c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d31403-5109-4b2d-9554-44e08b55e6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-892197658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc118de8-4a34-4eba-8e8c-89787ea707fe,host='devstack@QuobyteHD#QuobyteHD',id=d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfeb9ad7d9a1491db2b0bab27b2d61e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:30:16Z,use_quota=True,user_id='8253e96f724d430f8fab1cb90d9aa3c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44cbb445-c970-477c-be00-fe9ed62a14e6),volume_type_id=44cbb445-c970-477c-be00-fe9ed62a14e6)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b9c4a4-6ad1-45f4-b4e3-79d0c8a1e88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b9c4a4-6ad1-45f4-b4e3-79d0c8a1e88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b478385-7c7b-4c0d-acd7-55956723198a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b478385-7c7b-4c0d-acd7-55956723198a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d', 'volume_name': 'volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa677120-5100-46c8-8eca-f2487d6db5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa677120-5100-46c8-8eca-f2487d6db5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440bec14-fe18-47cb-86bb-37cf4afd6bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:16 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Volume d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d', 'volume_size': 1} Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dc118de8-4a34-4eba-8e8c-89787ea707fe,created_at=2026-07-09T22:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-892197658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc118de8-4a34-4eba-8e8c-89787ea707fe,host='devstack@QuobyteHD#QuobyteHD',id=d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfeb9ad7d9a1491db2b0bab27b2d61e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:30:16Z,use_quota=True,user_id='8253e96f724d430f8fab1cb90d9aa3c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44cbb445-c970-477c-be00-fe9ed62a14e6),volume_type_id=44cbb445-c970-477c-be00-fe9ed62a14e6)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Creating volume d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:30:16 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:30:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:16 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-27c13f94-96f2-4276-a297-4bbea6cd75f4 req-62ace2b3-922f-449c-9170-adf69a2a9b41 tempest-VolumesSnapshotsTestJSON-2044427623 None] Created volume successfully. Jul 10 00:30:16 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d 1073741824 Jul 10 00:30:16 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-6da396b4-fde2-4910-bca9-cdbfc11172a1 req-5f0a597d-3689-491c-a6c7-a297689ea2b7 tempest-VolumesSnapshotsTestJSON-2044427623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:18 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d 1073741824" returned: 0 in 1.324s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:18 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d Jul 10 00:30:18 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:18 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d" returned: 0 in 0.831s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:18 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] <== create_volume: return (2205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:30:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.208s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-6da396b4-fde2-4910-bca9-cdbfc11172a1 req-5f0a597d-3689-491c-a6c7-a297689ea2b7 tempest-VolumesSnapshotsTestJSON-2044427623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.970s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:18 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440bec14-fe18-47cb-86bb-37cf4afd6bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:18 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c130b8-5c7f-464d-861b-79251ddc9b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:18 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [req-6da396b4-fde2-4910-bca9-cdbfc11172a1 req-5f0a597d-3689-491c-a6c7-a297689ea2b7 tempest-VolumesSnapshotsTestJSON-2044427623 None] Creating offline snapshot e7e679c7-554c-43f1-a396-47cfe35d0d6a of volume de364477-e75b-4612-a3ac-2af7aadf4416 {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:30:18 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Volume volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d (d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d): created successfully Jul 10 00:30:18 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c130b8-5c7f-464d-861b-79251ddc9b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:18 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Flow 'volume_create_manager' (edf029cc-bb67-4bfd-878b-f631ed2fa60c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:30:18 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f21db73-a0b2-4a4b-a337-b69556bee8a4]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-6da396b4-fde2-4910-bca9-cdbfc11172a1 req-5f0a597d-3689-491c-a6c7-a297689ea2b7 tempest-VolumesSnapshotsTestJSON-2044427623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:19 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-c51ec19a-9c0d-41b0-a367-77af7b082c22 tempest-GroupSnapshotsTest-103019903 None] Created volume successfully. Jul 10 00:30:19 devstack sudo[97356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416 Jul 10 00:30:19 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:19 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-6da396b4-fde2-4910-bca9-cdbfc11172a1 req-5f0a597d-3689-491c-a6c7-a297689ea2b7 tempest-VolumesSnapshotsTestJSON-2044427623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416" returned: 0 in 0.853s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-6da396b4-fde2-4910-bca9-cdbfc11172a1 req-5f0a597d-3689-491c-a6c7-a297689ea2b7 tempest-VolumesSnapshotsTestJSON-2044427623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416.e7e679c7-554c-43f1-a396-47cfe35d0d6a 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:19 devstack sudo[97362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416.e7e679c7-554c-43f1-a396-47cfe35d0d6a 1G Jul 10 00:30:19 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:20 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:30:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Flow 'volume_create_manager' (23b311de-cfd5-4a11-acf5-2d58a484b9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:30:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b11ca3-bada-4833-bcb1-170a01b04593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:20 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-6da396b4-fde2-4910-bca9-cdbfc11172a1 req-5f0a597d-3689-491c-a6c7-a297689ea2b7 tempest-VolumesSnapshotsTestJSON-2044427623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416.e7e679c7-554c-43f1-a396-47cfe35d0d6a 1G" returned: 0 in 1.045s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-6da396b4-fde2-4910-bca9-cdbfc11172a1 req-5f0a597d-3689-491c-a6c7-a297689ea2b7 tempest-VolumesSnapshotsTestJSON-2044427623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de364477-e75b-4612-a3ac-2af7aadf4416 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416.e7e679c7-554c-43f1-a396-47cfe35d0d6a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b11ca3-bada-4833-bcb1-170a01b04593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1509014261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc118de8-4a34-4eba-8e8c-89787ea707fe,host='devstack@QuobyteHD#QuobyteHD',id=da750728-da72-4a2a-9825-f61f34656ec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfeb9ad7d9a1491db2b0bab27b2d61e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:30:21Z,use_quota=True,user_id='8253e96f724d430f8fab1cb90d9aa3c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44cbb445-c970-477c-be00-fe9ed62a14e6),volume_type_id=44cbb445-c970-477c-be00-fe9ed62a14e6)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dbb1701-897a-4ba6-8ceb-3024928ce43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:20 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de364477-e75b-4612-a3ac-2af7aadf4416 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416.e7e679c7-554c-43f1-a396-47cfe35d0d6a Jul 10 00:30:20 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dbb1701-897a-4ba6-8ceb-3024928ce43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdba3de6-8bcc-422c-8d28-90d8269743c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdba3de6-8bcc-422c-8d28-90d8269743c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da750728-da72-4a2a-9825-f61f34656ec4', 'volume_name': 'volume-da750728-da72-4a2a-9825-f61f34656ec4', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811cf82c-3e44-4486-a6b1-277cebe227ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (811cf82c-3e44-4486-a6b1-277cebe227ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c7c9f0-3d86-4de2-9e05-26e9b1a72af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:20 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Volume da750728-da72-4a2a-9825-f61f34656ec4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da750728-da72-4a2a-9825-f61f34656ec4', 'volume_size': 1} Jul 10 00:30:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:21 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-6da396b4-fde2-4910-bca9-cdbfc11172a1 req-5f0a597d-3689-491c-a6c7-a297689ea2b7 tempest-VolumesSnapshotsTestJSON-2044427623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de364477-e75b-4612-a3ac-2af7aadf4416 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416.e7e679c7-554c-43f1-a396-47cfe35d0d6a" returned: 0 in 0.877s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:21 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [req-6da396b4-fde2-4910-bca9-cdbfc11172a1 req-5f0a597d-3689-491c-a6c7-a297689ea2b7 tempest-VolumesSnapshotsTestJSON-2044427623 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416.e7e679c7-554c-43f1-a396-47cfe35d0d6a is being set with open permissions: ugo+rw Jul 10 00:30:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-6da396b4-fde2-4910-bca9-cdbfc11172a1 req-5f0a597d-3689-491c-a6c7-a297689ea2b7 tempest-VolumesSnapshotsTestJSON-2044427623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416.e7e679c7-554c-43f1-a396-47cfe35d0d6a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:21 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416.e7e679c7-554c-43f1-a396-47cfe35d0d6a Jul 10 00:30:21 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:22 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2d157efa-a2cc-41a3-bc26-eba9ec5d7600 tempest-AttachVolumeNegativeTest-1454311424 None] Acquiring lock "cinder-870a44a5-1416-48fb-8f6b-6e8b26b1db55-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:22 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2d157efa-a2cc-41a3-bc26-eba9ec5d7600 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "cinder-870a44a5-1416-48fb-8f6b-6e8b26b1db55-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:22 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2d157efa-a2cc-41a3-bc26-eba9ec5d7600 tempest-AttachVolumeNegativeTest-1454311424 None] Acquiring lock "cinder-quobyte-870a44a5-1416-48fb-8f6b-6e8b26b1db55" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:22 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2d157efa-a2cc-41a3-bc26-eba9ec5d7600 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "cinder-quobyte-870a44a5-1416-48fb-8f6b-6e8b26b1db55" acquired by "delete_volume" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:22 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31e380f-f9d4-49b5-b496-fbc1fdac1d41]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2d157efa-a2cc-41a3-bc26-eba9ec5d7600 tempest-AttachVolumeNegativeTest-1454311424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-870a44a5-1416-48fb-8f6b-6e8b26b1db55 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:22 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-870a44a5-1416-48fb-8f6b-6e8b26b1db55 Jul 10 00:30:22 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:22 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-6da396b4-fde2-4910-bca9-cdbfc11172a1 req-5f0a597d-3689-491c-a6c7-a297689ea2b7 tempest-VolumesSnapshotsTestJSON-2044427623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416.e7e679c7-554c-43f1-a396-47cfe35d0d6a" returned: 0 in 0.784s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-6da396b4-fde2-4910-bca9-cdbfc11172a1 req-5f0a597d-3689-491c-a6c7-a297689ea2b7 tempest-VolumesSnapshotsTestJSON-2044427623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:22 devstack sudo[97380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416.info Jul 10 00:30:22 devstack sudo[97380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:23 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2d157efa-a2cc-41a3-bc26-eba9ec5d7600 tempest-AttachVolumeNegativeTest-1454311424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-870a44a5-1416-48fb-8f6b-6e8b26b1db55" returned: 0 in 0.970s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2d157efa-a2cc-41a3-bc26-eba9ec5d7600 tempest-AttachVolumeNegativeTest-1454311424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-870a44a5-1416-48fb-8f6b-6e8b26b1db55 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:23 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-870a44a5-1416-48fb-8f6b-6e8b26b1db55 Jul 10 00:30:23 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:23 devstack sudo[97380]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-6da396b4-fde2-4910-bca9-cdbfc11172a1 req-5f0a597d-3689-491c-a6c7-a297689ea2b7 tempest-VolumesSnapshotsTestJSON-2044427623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416.info" returned: 0 in 0.764s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:23 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [req-6da396b4-fde2-4910-bca9-cdbfc11172a1 req-5f0a597d-3689-491c-a6c7-a297689ea2b7 tempest-VolumesSnapshotsTestJSON-2044427623 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416.info is being set with open permissions: ugo+rw Jul 10 00:30:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-6da396b4-fde2-4910-bca9-cdbfc11172a1 req-5f0a597d-3689-491c-a6c7-a297689ea2b7 tempest-VolumesSnapshotsTestJSON-2044427623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:23 devstack sudo[97388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416.info Jul 10 00:30:23 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:23 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2d157efa-a2cc-41a3-bc26-eba9ec5d7600 tempest-AttachVolumeNegativeTest-1454311424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-870a44a5-1416-48fb-8f6b-6e8b26b1db55" returned: 0 in 0.768s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2d157efa-a2cc-41a3-bc26-eba9ec5d7600 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "cinder-quobyte-870a44a5-1416-48fb-8f6b-6e8b26b1db55" released by "delete_volume" :: held 1.781s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-2d157efa-a2cc-41a3-bc26-eba9ec5d7600 tempest-AttachVolumeNegativeTest-1454311424 None] Created reservations ['e9836a8d-fe9e-4f24-a56e-6e742a0f9816', 'a8107396-4889-4945-9a45-68a8f66a7194', '56ecd113-0903-453d-9679-b62f52946ad7', '3c6327fc-9c26-45c5-bf37-015768eb8160'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:30:24 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-6da396b4-fde2-4910-bca9-cdbfc11172a1 req-5f0a597d-3689-491c-a6c7-a297689ea2b7 tempest-VolumesSnapshotsTestJSON-2044427623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416.info" returned: 0 in 0.726s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-6da396b4-fde2-4910-bca9-cdbfc11172a1 req-5f0a597d-3689-491c-a6c7-a297689ea2b7 tempest-VolumesSnapshotsTestJSON-2044427623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.221s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.170s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dc118de8-4a34-4eba-8e8c-89787ea707fe,created_at=2026-07-09T22:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1509014261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dc118de8-4a34-4eba-8e8c-89787ea707fe,host='devstack@QuobyteHD#QuobyteHD',id=da750728-da72-4a2a-9825-f61f34656ec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfeb9ad7d9a1491db2b0bab27b2d61e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:30:21Z,use_quota=True,user_id='8253e96f724d430f8fab1cb90d9aa3c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44cbb445-c970-477c-be00-fe9ed62a14e6),volume_type_id=44cbb445-c970-477c-be00-fe9ed62a14e6)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Creating volume da750728-da72-4a2a-9825-f61f34656ec4 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:30:24 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:24 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4 1073741824 Jul 10 00:30:24 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:24 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-6da396b4-fde2-4910-bca9-cdbfc11172a1 req-5f0a597d-3689-491c-a6c7-a297689ea2b7 tempest-VolumesSnapshotsTestJSON-2044427623 None] Create snapshot completed successfully Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2d157efa-a2cc-41a3-bc26-eba9ec5d7600 tempest-AttachVolumeNegativeTest-1454311424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2d157efa-a2cc-41a3-bc26-eba9ec5d7600 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2d157efa-a2cc-41a3-bc26-eba9ec5d7600 tempest-AttachVolumeNegativeTest-1454311424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2d157efa-a2cc-41a3-bc26-eba9ec5d7600 tempest-AttachVolumeNegativeTest-1454311424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2d157efa-a2cc-41a3-bc26-eba9ec5d7600 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2d157efa-a2cc-41a3-bc26-eba9ec5d7600 tempest-AttachVolumeNegativeTest-1454311424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:24 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:30:24 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-67caae75-6df0-4f7f-a3ef-5cead78802e8 tempest-AttachVolumeNegativeTest-1454311424 None] Acquiring lock "cinder-6732d530-c096-4388-bc50-c036dec99de0-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-67caae75-6df0-4f7f-a3ef-5cead78802e8 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "cinder-6732d530-c096-4388-bc50-c036dec99de0-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-67caae75-6df0-4f7f-a3ef-5cead78802e8 tempest-AttachVolumeNegativeTest-1454311424 None] Acquiring lock "cinder-quobyte-6732d530-c096-4388-bc50-c036dec99de0" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-67caae75-6df0-4f7f-a3ef-5cead78802e8 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "cinder-quobyte-6732d530-c096-4388-bc50-c036dec99de0" acquired by "delete_volume" :: waited 0.033s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-13218f15-5452-4a11-85ee-daa826c034f0 req-17520f12-da5e-4806-b533-580f58dfc9b8 tempest-VolumesSnapshotsTestJSON-2044427623 None] Acquiring lock "cinder-e7e679c7-554c-43f1-a396-47cfe35d0d6a-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91e3591-1a7a-4b99-b33c-1809ec9c2354]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-67caae75-6df0-4f7f-a3ef-5cead78802e8 tempest-AttachVolumeNegativeTest-1454311424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6732d530-c096-4388-bc50-c036dec99de0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-13218f15-5452-4a11-85ee-daa826c034f0 req-17520f12-da5e-4806-b533-580f58dfc9b8 tempest-VolumesSnapshotsTestJSON-2044427623 None] Lock "cinder-e7e679c7-554c-43f1-a396-47cfe35d0d6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-13218f15-5452-4a11-85ee-daa826c034f0 req-17520f12-da5e-4806-b533-580f58dfc9b8 tempest-VolumesSnapshotsTestJSON-2044427623 None] Acquiring lock "cinder-quobyte-de364477-e75b-4612-a3ac-2af7aadf4416" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-13218f15-5452-4a11-85ee-daa826c034f0 req-17520f12-da5e-4806-b533-580f58dfc9b8 tempest-VolumesSnapshotsTestJSON-2044427623 None] Lock "cinder-quobyte-de364477-e75b-4612-a3ac-2af7aadf4416" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-13218f15-5452-4a11-85ee-daa826c034f0 req-17520f12-da5e-4806-b533-580f58dfc9b8 tempest-VolumesSnapshotsTestJSON-2044427623 None] Acquiring lock "cinder-quobyte-e7e679c7-554c-43f1-a396-47cfe35d0d6a" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-13218f15-5452-4a11-85ee-daa826c034f0 req-17520f12-da5e-4806-b533-580f58dfc9b8 tempest-VolumesSnapshotsTestJSON-2044427623 None] Lock "cinder-quobyte-e7e679c7-554c-43f1-a396-47cfe35d0d6a" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [req-13218f15-5452-4a11-85ee-daa826c034f0 req-17520f12-da5e-4806-b533-580f58dfc9b8 tempest-VolumesSnapshotsTestJSON-2044427623 None] Deleting offline snapshot e7e679c7-554c-43f1-a396-47cfe35d0d6a of volume de364477-e75b-4612-a3ac-2af7aadf4416 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [req-13218f15-5452-4a11-85ee-daa826c034f0 req-17520f12-da5e-4806-b533-580f58dfc9b8 tempest-VolumesSnapshotsTestJSON-2044427623 None] snapshot_file for this snap is: volume-de364477-e75b-4612-a3ac-2af7aadf4416.e7e679c7-554c-43f1-a396-47cfe35d0d6a {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63cb756-b63c-4c38-acde-35d684a6ec19]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-13218f15-5452-4a11-85ee-daa826c034f0 req-17520f12-da5e-4806-b533-580f58dfc9b8 tempest-VolumesSnapshotsTestJSON-2044427623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416.e7e679c7-554c-43f1-a396-47cfe35d0d6a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:24 devstack sudo[97400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6732d530-c096-4388-bc50-c036dec99de0 Jul 10 00:30:24 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:25 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2d157efa-a2cc-41a3-bc26-eba9ec5d7600 tempest-AttachVolumeNegativeTest-1454311424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.856s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:25 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-2d157efa-a2cc-41a3-bc26-eba9ec5d7600 tempest-AttachVolumeNegativeTest-1454311424 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:30:25 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-2d157efa-a2cc-41a3-bc26-eba9ec5d7600 tempest-AttachVolumeNegativeTest-1454311424 None] Deleted volume successfully. Jul 10 00:30:25 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416.e7e679c7-554c-43f1-a396-47cfe35d0d6a Jul 10 00:30:25 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:25 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2d157efa-a2cc-41a3-bc26-eba9ec5d7600 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "cinder-870a44a5-1416-48fb-8f6b-6e8b26b1db55-delete_volume" released by "delete_volume" :: held 2.980s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:25 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4 1073741824" returned: 0 in 1.118s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:25 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4 Jul 10 00:30:25 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:25 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-67caae75-6df0-4f7f-a3ef-5cead78802e8 tempest-AttachVolumeNegativeTest-1454311424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6732d530-c096-4388-bc50-c036dec99de0" returned: 0 in 1.059s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-67caae75-6df0-4f7f-a3ef-5cead78802e8 tempest-AttachVolumeNegativeTest-1454311424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6732d530-c096-4388-bc50-c036dec99de0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:25 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6732d530-c096-4388-bc50-c036dec99de0 Jul 10 00:30:25 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:26 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-13218f15-5452-4a11-85ee-daa826c034f0 req-17520f12-da5e-4806-b533-580f58dfc9b8 tempest-VolumesSnapshotsTestJSON-2044427623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416.e7e679c7-554c-43f1-a396-47cfe35d0d6a" returned: 0 in 1.063s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [req-13218f15-5452-4a11-85ee-daa826c034f0 req-17520f12-da5e-4806-b533-580f58dfc9b8 tempest-VolumesSnapshotsTestJSON-2044427623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de364477-e75b-4612-a3ac-2af7aadf4416(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:30:26 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fed32a-116c-43c3-9225-d327a96fa7f8]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-13218f15-5452-4a11-85ee-daa826c034f0 req-17520f12-da5e-4806-b533-580f58dfc9b8 tempest-VolumesSnapshotsTestJSON-2044427623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:26 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4" returned: 0 in 0.849s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:30:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.032s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c7c9f0-3d86-4de2-9e05-26e9b1a72af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da750728-da72-4a2a-9825-f61f34656ec4', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7554d195-e854-4d1b-adfe-3f3b43578143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:26 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Volume volume-da750728-da72-4a2a-9825-f61f34656ec4 (da750728-da72-4a2a-9825-f61f34656ec4): created successfully Jul 10 00:30:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7554d195-e854-4d1b-adfe-3f3b43578143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Flow 'volume_create_manager' (23b311de-cfd5-4a11-acf5-2d58a484b9d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:30:26 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-1e4f9e7c-e89a-48ad-8f6f-069b74a5da29 tempest-GroupSnapshotsTest-103019903 None] Created volume successfully. Jul 10 00:30:26 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416 Jul 10 00:30:26 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:26 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-67caae75-6df0-4f7f-a3ef-5cead78802e8 tempest-AttachVolumeNegativeTest-1454311424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6732d530-c096-4388-bc50-c036dec99de0" returned: 0 in 0.744s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-67caae75-6df0-4f7f-a3ef-5cead78802e8 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "cinder-quobyte-6732d530-c096-4388-bc50-c036dec99de0" released by "delete_volume" :: held 1.890s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:26 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-67caae75-6df0-4f7f-a3ef-5cead78802e8 tempest-AttachVolumeNegativeTest-1454311424 None] Created reservations ['3372be28-0b93-4978-9e2f-7a5a27e71c21', '805a076b-c62c-4498-a784-3d32038c938b', '6b50203e-1082-40f5-8dcd-f6c7ffe52cd3', 'de479bef-741b-47de-b0b3-e9960758fabe'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:30:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-67caae75-6df0-4f7f-a3ef-5cead78802e8 tempest-AttachVolumeNegativeTest-1454311424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-67caae75-6df0-4f7f-a3ef-5cead78802e8 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-67caae75-6df0-4f7f-a3ef-5cead78802e8 tempest-AttachVolumeNegativeTest-1454311424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:30:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-67caae75-6df0-4f7f-a3ef-5cead78802e8 tempest-AttachVolumeNegativeTest-1454311424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:30:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-67caae75-6df0-4f7f-a3ef-5cead78802e8 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-67caae75-6df0-4f7f-a3ef-5cead78802e8 tempest-AttachVolumeNegativeTest-1454311424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:26 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:30:26 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:27 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-13218f15-5452-4a11-85ee-daa826c034f0 req-17520f12-da5e-4806-b533-580f58dfc9b8 tempest-VolumesSnapshotsTestJSON-2044427623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416" returned: 0 in 1.016s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-13218f15-5452-4a11-85ee-daa826c034f0 req-17520f12-da5e-4806-b533-580f58dfc9b8 tempest-VolumesSnapshotsTestJSON-2044427623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416.e7e679c7-554c-43f1-a396-47cfe35d0d6a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:27 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416.e7e679c7-554c-43f1-a396-47cfe35d0d6a Jul 10 00:30:27 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:27 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fb7ca83d-fe04-49ec-802c-b50d317ddb46 tempest-AttachVolumeNegativeTest-1454311424 None] Acquiring lock "cinder-0bf00c08-8b14-48cb-89bd-a959e5fc3c62-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:27 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fb7ca83d-fe04-49ec-802c-b50d317ddb46 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "cinder-0bf00c08-8b14-48cb-89bd-a959e5fc3c62-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:27 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fb7ca83d-fe04-49ec-802c-b50d317ddb46 tempest-AttachVolumeNegativeTest-1454311424 None] Acquiring lock "cinder-quobyte-0bf00c08-8b14-48cb-89bd-a959e5fc3c62" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:27 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-9fad675a-4de2-4042-86fb-8d193ac328e4 tempest-GroupSnapshotsTest-103019903 None] Update group completed successfully. Jul 10 00:30:27 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fb7ca83d-fe04-49ec-802c-b50d317ddb46 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "cinder-quobyte-0bf00c08-8b14-48cb-89bd-a959e5fc3c62" acquired by "delete_volume" :: waited 0.028s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:27 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[218fbb27-f3f8-4117-aa2f-bfa26a68072e]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fb7ca83d-fe04-49ec-802c-b50d317ddb46 tempest-AttachVolumeNegativeTest-1454311424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-0bf00c08-8b14-48cb-89bd-a959e5fc3c62 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:27 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-0bf00c08-8b14-48cb-89bd-a959e5fc3c62 Jul 10 00:30:27 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:27 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-67caae75-6df0-4f7f-a3ef-5cead78802e8 tempest-AttachVolumeNegativeTest-1454311424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.936s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:27 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-67caae75-6df0-4f7f-a3ef-5cead78802e8 tempest-AttachVolumeNegativeTest-1454311424 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:30:27 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-67caae75-6df0-4f7f-a3ef-5cead78802e8 tempest-AttachVolumeNegativeTest-1454311424 None] Deleted volume successfully. Jul 10 00:30:27 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-67caae75-6df0-4f7f-a3ef-5cead78802e8 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "cinder-6732d530-c096-4388-bc50-c036dec99de0-delete_volume" released by "delete_volume" :: held 3.115s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:28 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-13218f15-5452-4a11-85ee-daa826c034f0 req-17520f12-da5e-4806-b533-580f58dfc9b8 tempest-VolumesSnapshotsTestJSON-2044427623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416.e7e679c7-554c-43f1-a396-47cfe35d0d6a" returned: 0 in 0.923s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-13218f15-5452-4a11-85ee-daa826c034f0 req-17520f12-da5e-4806-b533-580f58dfc9b8 tempest-VolumesSnapshotsTestJSON-2044427623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416.e7e679c7-554c-43f1-a396-47cfe35d0d6a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:28 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416.e7e679c7-554c-43f1-a396-47cfe35d0d6a Jul 10 00:30:28 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:28 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fb7ca83d-fe04-49ec-802c-b50d317ddb46 tempest-AttachVolumeNegativeTest-1454311424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-0bf00c08-8b14-48cb-89bd-a959e5fc3c62" returned: 0 in 0.826s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fb7ca83d-fe04-49ec-802c-b50d317ddb46 tempest-AttachVolumeNegativeTest-1454311424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-0bf00c08-8b14-48cb-89bd-a959e5fc3c62 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:28 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-0bf00c08-8b14-48cb-89bd-a959e5fc3c62 Jul 10 00:30:28 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:28 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-5aac6b33-56ed-4cc2-8b3a-26392b469e39 tempest-GroupSnapshotsTest-103019903 None] Update group completed successfully. Jul 10 00:30:28 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-13218f15-5452-4a11-85ee-daa826c034f0 req-17520f12-da5e-4806-b533-580f58dfc9b8 tempest-VolumesSnapshotsTestJSON-2044427623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416.e7e679c7-554c-43f1-a396-47cfe35d0d6a" returned: 0 in 0.754s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:28 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-13218f15-5452-4a11-85ee-daa826c034f0 req-17520f12-da5e-4806-b533-580f58dfc9b8 tempest-VolumesSnapshotsTestJSON-2044427623 None] Lock "cinder-quobyte-e7e679c7-554c-43f1-a396-47cfe35d0d6a" released by "_delete_snapshot" :: held 3.901s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:28 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-13218f15-5452-4a11-85ee-daa826c034f0 req-17520f12-da5e-4806-b533-580f58dfc9b8 tempest-VolumesSnapshotsTestJSON-2044427623 None] Lock "cinder-quobyte-de364477-e75b-4612-a3ac-2af7aadf4416" released by "delete_snapshot" :: held 3.946s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:28 devstack cinder-volume[88119]: DEBUG cinder.quota [req-13218f15-5452-4a11-85ee-daa826c034f0 req-17520f12-da5e-4806-b533-580f58dfc9b8 tempest-VolumesSnapshotsTestJSON-2044427623 None] Created reservations ['e59f8d73-20ff-4dd0-a7d6-4f5cd4ee525e', '6ba6234f-dcbb-4dc3-b030-83beaab1db82', '5ec98d26-b767-4891-96b5-621cde3d09ad', 'e45996f5-bf76-484f-981f-f69ddabcabc8'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:30:28 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fb7ca83d-fe04-49ec-802c-b50d317ddb46 tempest-AttachVolumeNegativeTest-1454311424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-0bf00c08-8b14-48cb-89bd-a959e5fc3c62" returned: 0 in 0.775s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:29 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fb7ca83d-fe04-49ec-802c-b50d317ddb46 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "cinder-quobyte-0bf00c08-8b14-48cb-89bd-a959e5fc3c62" released by "delete_volume" :: held 1.658s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:29 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-13218f15-5452-4a11-85ee-daa826c034f0 req-17520f12-da5e-4806-b533-580f58dfc9b8 tempest-VolumesSnapshotsTestJSON-2044427623 None] Delete snapshot completed successfully. Jul 10 00:30:29 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-13218f15-5452-4a11-85ee-daa826c034f0 req-17520f12-da5e-4806-b533-580f58dfc9b8 tempest-VolumesSnapshotsTestJSON-2044427623 None] Lock "cinder-e7e679c7-554c-43f1-a396-47cfe35d0d6a-delete_snapshot" released by "delete_snapshot" :: held 4.167s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:29 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-fb7ca83d-fe04-49ec-802c-b50d317ddb46 tempest-AttachVolumeNegativeTest-1454311424 None] Created reservations ['2ff896a2-f4c0-48b0-926f-e9a5a0c1b01d', '664dcbc4-b19a-4a12-bf1d-40501a27e799', '5e6ebc19-9327-46b6-aae0-05938d97fa38', 'ff6b5ddb-4204-431b-8e53-96afe14e59ba'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:30:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-fb7ca83d-fe04-49ec-802c-b50d317ddb46 tempest-AttachVolumeNegativeTest-1454311424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-fb7ca83d-fe04-49ec-802c-b50d317ddb46 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:29 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-fb7ca83d-fe04-49ec-802c-b50d317ddb46 tempest-AttachVolumeNegativeTest-1454311424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:30:29 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-fb7ca83d-fe04-49ec-802c-b50d317ddb46 tempest-AttachVolumeNegativeTest-1454311424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:30:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-fb7ca83d-fe04-49ec-802c-b50d317ddb46 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fb7ca83d-fe04-49ec-802c-b50d317ddb46 tempest-AttachVolumeNegativeTest-1454311424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:29 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:30:29 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:29 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-fd3d997f-5144-45d4-8919-49fdf8e26823 req-0769fb0a-f7c0-47fc-a01d-225696b6d749 tempest-VolumesSnapshotsTestJSON-2044427623 None] Acquiring lock "cinder-de364477-e75b-4612-a3ac-2af7aadf4416-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:29 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-fd3d997f-5144-45d4-8919-49fdf8e26823 req-0769fb0a-f7c0-47fc-a01d-225696b6d749 tempest-VolumesSnapshotsTestJSON-2044427623 None] Lock "cinder-de364477-e75b-4612-a3ac-2af7aadf4416-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:29 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-fd3d997f-5144-45d4-8919-49fdf8e26823 req-0769fb0a-f7c0-47fc-a01d-225696b6d749 tempest-VolumesSnapshotsTestJSON-2044427623 None] Acquiring lock "cinder-quobyte-de364477-e75b-4612-a3ac-2af7aadf4416" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:29 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-fd3d997f-5144-45d4-8919-49fdf8e26823 req-0769fb0a-f7c0-47fc-a01d-225696b6d749 tempest-VolumesSnapshotsTestJSON-2044427623 None] Lock "cinder-quobyte-de364477-e75b-4612-a3ac-2af7aadf4416" acquired by "delete_volume" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:29 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[797611e6-df8b-44ed-a3a6-4e415be31e2f]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-fd3d997f-5144-45d4-8919-49fdf8e26823 req-0769fb0a-f7c0-47fc-a01d-225696b6d749 tempest-VolumesSnapshotsTestJSON-2044427623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:29 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416 Jul 10 00:30:29 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:29 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-87dffbab-82bc-47f8-82a0-c0a4090173a4 tempest-GroupSnapshotsTest-103019903 None] Update group completed successfully. Jul 10 00:30:30 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fb7ca83d-fe04-49ec-802c-b50d317ddb46 tempest-AttachVolumeNegativeTest-1454311424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.878s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:30 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-fb7ca83d-fe04-49ec-802c-b50d317ddb46 tempest-AttachVolumeNegativeTest-1454311424 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:30:30 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-fb7ca83d-fe04-49ec-802c-b50d317ddb46 tempest-AttachVolumeNegativeTest-1454311424 None] Deleted volume successfully. Jul 10 00:30:30 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fb7ca83d-fe04-49ec-802c-b50d317ddb46 tempest-AttachVolumeNegativeTest-1454311424 None] Lock "cinder-0bf00c08-8b14-48cb-89bd-a959e5fc3c62-delete_volume" released by "delete_volume" :: held 2.807s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:30 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-fd3d997f-5144-45d4-8919-49fdf8e26823 req-0769fb0a-f7c0-47fc-a01d-225696b6d749 tempest-VolumesSnapshotsTestJSON-2044427623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416" returned: 0 in 0.953s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-fd3d997f-5144-45d4-8919-49fdf8e26823 req-0769fb0a-f7c0-47fc-a01d-225696b6d749 tempest-VolumesSnapshotsTestJSON-2044427623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:30 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416 Jul 10 00:30:30 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:31 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-074d4e25-8b41-44bb-95f0-474b3a3102b0 tempest-GroupSnapshotsTest-103019903 None] Update group completed successfully. Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Flow 'volume_create_manager' (b051c1d8-d27c-4ee6-ac4f-1408cab183b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44aee858-d406-448e-a4c2-e0d884210193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44aee858-d406-448e-a4c2-e0d884210193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1167339249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caf86e45be3d4392b06fe751144235ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:30:31Z,use_quota=True,user_id='96523657f5324cd794cb0c1fa101cb68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a623fc73-469f-4684-ad6e-0cdffe7c1b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a623fc73-469f-4684-ad6e-0cdffe7c1b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a7ec7c4-630a-4353-ae7e-c98a4e884b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a7ec7c4-630a-4353-ae7e-c98a4e884b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d', 'volume_name': 'volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3918ecaa-8e74-41d6-bb8c-f4fc28ac3cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3918ecaa-8e74-41d6-bb8c-f4fc28ac3cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc17cc9-84ef-48ba-b4f2-66bf5adf58b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:31 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Volume 4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d', 'volume_size': 1} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1167339249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caf86e45be3d4392b06fe751144235ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:30:31Z,use_quota=True,user_id='96523657f5324cd794cb0c1fa101cb68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Creating volume 4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:30:31 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:30:31 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-fd3d997f-5144-45d4-8919-49fdf8e26823 req-0769fb0a-f7c0-47fc-a01d-225696b6d749 tempest-VolumesSnapshotsTestJSON-2044427623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-de364477-e75b-4612-a3ac-2af7aadf4416" returned: 0 in 0.941s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:31 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d 1073741824 Jul 10 00:30:31 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-fd3d997f-5144-45d4-8919-49fdf8e26823 req-0769fb0a-f7c0-47fc-a01d-225696b6d749 tempest-VolumesSnapshotsTestJSON-2044427623 None] Lock "cinder-quobyte-de364477-e75b-4612-a3ac-2af7aadf4416" released by "delete_volume" :: held 1.978s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG cinder.quota [req-fd3d997f-5144-45d4-8919-49fdf8e26823 req-0769fb0a-f7c0-47fc-a01d-225696b6d749 tempest-VolumesSnapshotsTestJSON-2044427623 None] Created reservations ['c011f981-b5ef-443e-bd57-5e97253c44a5', '3eb91187-4d78-45f3-a0a0-3443f6592bad', 'd06f04d0-3803-424b-86cd-a326daf5e7b2', '5678bd2a-d063-46a6-bdf5-63132d00f6b1'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-fd3d997f-5144-45d4-8919-49fdf8e26823 req-0769fb0a-f7c0-47fc-a01d-225696b6d749 tempest-VolumesSnapshotsTestJSON-2044427623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-fd3d997f-5144-45d4-8919-49fdf8e26823 req-0769fb0a-f7c0-47fc-a01d-225696b6d749 tempest-VolumesSnapshotsTestJSON-2044427623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [req-fd3d997f-5144-45d4-8919-49fdf8e26823 req-0769fb0a-f7c0-47fc-a01d-225696b6d749 tempest-VolumesSnapshotsTestJSON-2044427623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:30:31 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:30:31 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [req-fd3d997f-5144-45d4-8919-49fdf8e26823 req-0769fb0a-f7c0-47fc-a01d-225696b6d749 tempest-VolumesSnapshotsTestJSON-2044427623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-fd3d997f-5144-45d4-8919-49fdf8e26823 req-0769fb0a-f7c0-47fc-a01d-225696b6d749 tempest-VolumesSnapshotsTestJSON-2044427623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-fd3d997f-5144-45d4-8919-49fdf8e26823 req-0769fb0a-f7c0-47fc-a01d-225696b6d749 tempest-VolumesSnapshotsTestJSON-2044427623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:31 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:30:31 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:32 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.985s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:32 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:30:32 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-fd3d997f-5144-45d4-8919-49fdf8e26823 req-0769fb0a-f7c0-47fc-a01d-225696b6d749 tempest-VolumesSnapshotsTestJSON-2044427623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.942s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:32 devstack cinder-volume[88119]: DEBUG cinder.manager [req-fd3d997f-5144-45d4-8919-49fdf8e26823 req-0769fb0a-f7c0-47fc-a01d-225696b6d749 tempest-VolumesSnapshotsTestJSON-2044427623 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:30:32 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:30:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 8 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:30:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:30:32 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-fd3d997f-5144-45d4-8919-49fdf8e26823 req-0769fb0a-f7c0-47fc-a01d-225696b6d749 tempest-VolumesSnapshotsTestJSON-2044427623 None] Deleted volume successfully. Jul 10 00:30:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-fd3d997f-5144-45d4-8919-49fdf8e26823 req-0769fb0a-f7c0-47fc-a01d-225696b6d749 tempest-VolumesSnapshotsTestJSON-2044427623 None] Lock "cinder-de364477-e75b-4612-a3ac-2af7aadf4416-delete_volume" released by "delete_volume" :: held 3.299s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:32 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d 1073741824" returned: 0 in 1.302s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:32 devstack sudo[97509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d Jul 10 00:30:32 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:32 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] GroupSnapshot 1b216f2a-9d4c-4583-8d59-bee2ec2515ad: creating. Jul 10 00:30:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] Group snapshot 1b216f2a-9d4c-4583-8d59-bee2ec2515ad: creating. {{(pid=88119) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jul 10 00:30:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:33 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d" returned: 0 in 0.855s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] <== create_volume: return (2213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:30:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.216s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.601s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] Creating offline snapshot 89d1aafd-bca6-47ed-b220-b0f9efbe817f of volume da750728-da72-4a2a-9825-f61f34656ec4 {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:30:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc17cc9-84ef-48ba-b4f2-66bf5adf58b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de498581-fe4d-4f80-b23f-19f1f879758c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:33 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d0da51-7b1a-4710-80d2-bcbe9ea52dec]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:33 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Volume volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d (4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d): created successfully Jul 10 00:30:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de498581-fe4d-4f80-b23f-19f1f879758c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Flow 'volume_create_manager' (b051c1d8-d27c-4ee6-ac4f-1408cab183b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:30:33 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-b3463136-3f67-46ed-84bc-8f5f41826042 tempest-VolumesDeleteCascade-469997548 None] Created volume successfully. Jul 10 00:30:33 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4 Jul 10 00:30:33 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-08979864-a188-4857-81d0-b7e28b651dff tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:34 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4" returned: 0 in 0.998s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4.89d1aafd-bca6-47ed-b220-b0f9efbe817f 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:34 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4.89d1aafd-bca6-47ed-b220-b0f9efbe817f 1G Jul 10 00:30:34 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:35 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4.89d1aafd-bca6-47ed-b220-b0f9efbe817f 1G" returned: 0 in 0.967s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da750728-da72-4a2a-9825-f61f34656ec4 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4.89d1aafd-bca6-47ed-b220-b0f9efbe817f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:35 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da750728-da72-4a2a-9825-f61f34656ec4 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4.89d1aafd-bca6-47ed-b220-b0f9efbe817f Jul 10 00:30:35 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:36 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da750728-da72-4a2a-9825-f61f34656ec4 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4.89d1aafd-bca6-47ed-b220-b0f9efbe817f" returned: 0 in 0.728s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:36 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4.89d1aafd-bca6-47ed-b220-b0f9efbe817f is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:30:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4.89d1aafd-bca6-47ed-b220-b0f9efbe817f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:36 devstack sudo[97530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4.89d1aafd-bca6-47ed-b220-b0f9efbe817f Jul 10 00:30:36 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:36 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4.89d1aafd-bca6-47ed-b220-b0f9efbe817f" returned: 0 in 0.674s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:37 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4.info Jul 10 00:30:37 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:37 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-f392dcf4-261f-4c28-bc49-493c278d71e8 tempest-GroupSnapshotsV319Test-2043529679 None] Group tempest-GroupSnapshotsV319Test-Group-872927920: creating Jul 10 00:30:37 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-f392dcf4-261f-4c28-bc49-493c278d71e8 tempest-GroupSnapshotsV319Test-2043529679 None] Group tempest-GroupSnapshotsV319Test-Group-872927920: created successfully Jul 10 00:30:37 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-f392dcf4-261f-4c28-bc49-493c278d71e8 tempest-GroupSnapshotsV319Test-2043529679 None] Create group completed successfully. Jul 10 00:30:37 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4.info" returned: 0 in 0.703s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:37 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:30:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:37 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4.info Jul 10 00:30:37 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:38 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4.info" returned: 0 in 0.649s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.818s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:38 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] Creating offline snapshot d3fc9f5c-ca04-4157-9fb8-d9e30c12e2f9 of volume d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:30:38 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e24027-9cfd-4268-8e80-bd9828ed2a40]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:38 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d Jul 10 00:30:38 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f4c373cb-bf28-4e1d-8aff-d4c70f7687b7 tempest-BackendsCapabilitiesAdminTestsJSON-47386435 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88119) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}} Jul 10 00:30:39 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:30:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Flow 'volume_create_manager' (fce4f67b-8339-40b9-ac1d-ad4e0f8fd25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:30:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db979117-1b97-4ed8-b8bc-1aa0744ef640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db979117-1b97-4ed8-b8bc-1aa0744ef640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1253849941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9d732e9a-1c2e-470f-a52c-55cb5e30e992,host='devstack@QuobyteHD#QuobyteHD',id=79563bd3-a6da-49cc-a5d7-0d27fff4ce06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='558b0019d2e541e8ac121a5dfb86177c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:30:39Z,use_quota=True,user_id='08821a996f5847b8bec0f605b6d41553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e907589e-dddc-43ef-b670-271102787a2f),volume_type_id=e907589e-dddc-43ef-b670-271102787a2f)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2761d602-e503-4dfc-9d10-d215ae69f373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2761d602-e503-4dfc-9d10-d215ae69f373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb15cc0-4c6e-4f53-a89b-fbf5c8ecb934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb15cc0-4c6e-4f53-a89b-fbf5c8ecb934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79563bd3-a6da-49cc-a5d7-0d27fff4ce06', 'volume_name': 'volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24287116-4e93-4a65-ae71-41e4194914fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24287116-4e93-4a65-ae71-41e4194914fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea0c8586-4c08-42ff-9931-df04b0ba3ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:39 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Volume 79563bd3-a6da-49cc-a5d7-0d27fff4ce06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06', 'volume_size': 1} Jul 10 00:30:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:39 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d" returned: 0 in 0.824s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.d3fc9f5c-ca04-4157-9fb8-d9e30c12e2f9 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:39 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.d3fc9f5c-ca04-4157-9fb8-d9e30c12e2f9 1G Jul 10 00:30:39 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a232a610-a2c4-495e-8c31-3095f846e5fb tempest-BackendsCapabilitiesAdminTestsJSON-47386435 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88119) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}} Jul 10 00:30:40 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.d3fc9f5c-ca04-4157-9fb8-d9e30c12e2f9 1G" returned: 0 in 0.881s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.d3fc9f5c-ca04-4157-9fb8-d9e30c12e2f9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:40 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.d3fc9f5c-ca04-4157-9fb8-d9e30c12e2f9 Jul 10 00:30:40 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:40 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.d3fc9f5c-ca04-4157-9fb8-d9e30c12e2f9" returned: 0 in 0.834s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:40 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.d3fc9f5c-ca04-4157-9fb8-d9e30c12e2f9 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:30:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.d3fc9f5c-ca04-4157-9fb8-d9e30c12e2f9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:40 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.d3fc9f5c-ca04-4157-9fb8-d9e30c12e2f9 Jul 10 00:30:40 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:41 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.d3fc9f5c-ca04-4157-9fb8-d9e30c12e2f9" returned: 0 in 0.744s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:41 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.info Jul 10 00:30:41 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:42 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.info" returned: 0 in 0.770s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:42 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:30:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:42 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.info Jul 10 00:30:42 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:43 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.info" returned: 0 in 0.735s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.878s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-08979864-a188-4857-81d0-b7e28b651dff tempest-VolumesDeleteCascade-469997548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.722s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-08979864-a188-4857-81d0-b7e28b651dff tempest-VolumesDeleteCascade-469997548 None] Creating offline snapshot 1ddeadd6-cf7e-43f6-8960-5f040e150936 of volume 4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:30:43 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[302a2e23-26bd-4893-b6e6-4aef0c8e5c19]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08979864-a188-4857-81d0-b7e28b651dff tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:43 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-92b177a6-b078-4f66-9239-f73764d59882 tempest-GroupSnapshotsTest-103019903 None] group_snapshot 1b216f2a-9d4c-4583-8d59-bee2ec2515ad: created successfully Jul 10 00:30:43 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d Jul 10 00:30:43 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:43 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] group_snapshot 1b216f2a-9d4c-4583-8d59-bee2ec2515ad: deleting Jul 10 00:30:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] group_snapshot 1b216f2a-9d4c-4583-8d59-bee2ec2515ad: deleting {{(pid=88119) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jul 10 00:30:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "cinder-quobyte-da750728-da72-4a2a-9825-f61f34656ec4" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-da750728-da72-4a2a-9825-f61f34656ec4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "cinder-quobyte-89d1aafd-bca6-47ed-b220-b0f9efbe817f" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-89d1aafd-bca6-47ed-b220-b0f9efbe817f" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Deleting offline snapshot 89d1aafd-bca6-47ed-b220-b0f9efbe817f of volume da750728-da72-4a2a-9825-f61f34656ec4 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:30:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] snapshot_file for this snap is: volume-da750728-da72-4a2a-9825-f61f34656ec4.89d1aafd-bca6-47ed-b220-b0f9efbe817f {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:30:43 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c0b485-df5a-4114-b6d0-2c165834c7fa]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4.89d1aafd-bca6-47ed-b220-b0f9efbe817f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:44 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4.89d1aafd-bca6-47ed-b220-b0f9efbe817f Jul 10 00:30:44 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:44 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08979864-a188-4857-81d0-b7e28b651dff tempest-VolumesDeleteCascade-469997548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d" returned: 0 in 0.890s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08979864-a188-4857-81d0-b7e28b651dff tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:44 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936 1G Jul 10 00:30:44 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:44 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4.89d1aafd-bca6-47ed-b220-b0f9efbe817f" returned: 0 in 0.943s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da750728-da72-4a2a-9825-f61f34656ec4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:30:44 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79667fe-d674-4197-a2d1-cbdafa03e6fb]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:45 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4 Jul 10 00:30:45 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:45 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08979864-a188-4857-81d0-b7e28b651dff tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936 1G" returned: 0 in 1.018s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08979864-a188-4857-81d0-b7e28b651dff tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:45 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936 Jul 10 00:30:45 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:45 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4" returned: 0 in 0.931s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4.89d1aafd-bca6-47ed-b220-b0f9efbe817f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:45 devstack sudo[97591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4.89d1aafd-bca6-47ed-b220-b0f9efbe817f Jul 10 00:30:45 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:45 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08979864-a188-4857-81d0-b7e28b651dff tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936" returned: 0 in 0.733s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:45 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-08979864-a188-4857-81d0-b7e28b651dff tempest-VolumesDeleteCascade-469997548 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936 is being set with open permissions: ugo+rw Jul 10 00:30:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08979864-a188-4857-81d0-b7e28b651dff tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:45 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936 Jul 10 00:30:45 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:46 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4.89d1aafd-bca6-47ed-b220-b0f9efbe817f" returned: 0 in 0.831s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4.89d1aafd-bca6-47ed-b220-b0f9efbe817f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:46 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4.89d1aafd-bca6-47ed-b220-b0f9efbe817f Jul 10 00:30:46 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:46 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08979864-a188-4857-81d0-b7e28b651dff tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936" returned: 0 in 0.766s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08979864-a188-4857-81d0-b7e28b651dff tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:46 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.info Jul 10 00:30:46 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4.89d1aafd-bca6-47ed-b220-b0f9efbe817f" returned: 0 in 0.819s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:47 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-89d1aafd-bca6-47ed-b220-b0f9efbe817f" released by "_delete_snapshot" :: held 3.689s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:47 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-da750728-da72-4a2a-9825-f61f34656ec4" released by "delete_snapshot" :: held 3.727s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08979864-a188-4857-81d0-b7e28b651dff tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.info" returned: 0 in 0.738s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:47 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-08979864-a188-4857-81d0-b7e28b651dff tempest-VolumesDeleteCascade-469997548 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.info is being set with open permissions: ugo+rw Jul 10 00:30:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08979864-a188-4857-81d0-b7e28b651dff tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "cinder-quobyte-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:47 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.info Jul 10 00:30:47 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "cinder-quobyte-d3fc9f5c-ca04-4157-9fb8-d9e30c12e2f9" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-d3fc9f5c-ca04-4157-9fb8-d9e30c12e2f9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Deleting offline snapshot d3fc9f5c-ca04-4157-9fb8-d9e30c12e2f9 of volume d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:30:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] snapshot_file for this snap is: volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.d3fc9f5c-ca04-4157-9fb8-d9e30c12e2f9 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:30:47 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f65d34-3d0f-4836-8f09-0f5fcfa9e2ec]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.d3fc9f5c-ca04-4157-9fb8-d9e30c12e2f9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:47 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.d3fc9f5c-ca04-4157-9fb8-d9e30c12e2f9 Jul 10 00:30:47 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:48 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08979864-a188-4857-81d0-b7e28b651dff tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.info" returned: 0 in 0.730s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-08979864-a188-4857-81d0-b7e28b651dff tempest-VolumesDeleteCascade-469997548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.983s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.122s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9d732e9a-1c2e-470f-a52c-55cb5e30e992,created_at=2026-07-09T22:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1253849941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9d732e9a-1c2e-470f-a52c-55cb5e30e992,host='devstack@QuobyteHD#QuobyteHD',id=79563bd3-a6da-49cc-a5d7-0d27fff4ce06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='558b0019d2e541e8ac121a5dfb86177c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:30:39Z,use_quota=True,user_id='08821a996f5847b8bec0f605b6d41553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e907589e-dddc-43ef-b670-271102787a2f),volume_type_id=e907589e-dddc-43ef-b670-271102787a2f)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:30:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Creating volume 79563bd3-a6da-49cc-a5d7-0d27fff4ce06 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:30:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:30:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:30:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:30:48 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:30:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:48 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06 1073741824 Jul 10 00:30:48 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:48 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-08979864-a188-4857-81d0-b7e28b651dff tempest-VolumesDeleteCascade-469997548 None] Create snapshot completed successfully Jul 10 00:30:48 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.d3fc9f5c-ca04-4157-9fb8-d9e30c12e2f9" returned: 0 in 0.792s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:30:48 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7bc19d-7b06-4e91-af91-803866886d14]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:48 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d Jul 10 00:30:48 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:49 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06 1073741824" returned: 0 in 0.905s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:49 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06 Jul 10 00:30:49 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:49 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d" returned: 0 in 0.884s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.d3fc9f5c-ca04-4157-9fb8-d9e30c12e2f9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:49 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.d3fc9f5c-ca04-4157-9fb8-d9e30c12e2f9 Jul 10 00:30:49 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-bf973325-c8af-4b3b-b6dd-3c51d56b81c8 tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:50 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06" returned: 0 in 0.815s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:30:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-bf973325-c8af-4b3b-b6dd-3c51d56b81c8 tempest-VolumesDeleteCascade-469997548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.565s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea0c8586-4c08-42ff-9931-df04b0ba3ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4164a154-5177-403f-89ac-7716980c693d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-bf973325-c8af-4b3b-b6dd-3c51d56b81c8 tempest-VolumesDeleteCascade-469997548 None] Creating offline snapshot b248d00c-2063-410c-8efc-6ee431bf64f2 of volume 4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:30:50 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e97551d-5ea8-4d2e-9f66-cdbdaea368df]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bf973325-c8af-4b3b-b6dd-3c51d56b81c8 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:50 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Volume volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06 (79563bd3-a6da-49cc-a5d7-0d27fff4ce06): created successfully Jul 10 00:30:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4164a154-5177-403f-89ac-7716980c693d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Flow 'volume_create_manager' (fce4f67b-8339-40b9-ac1d-ad4e0f8fd25f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:30:50 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-8081e9c5-ec9d-4fbb-aef8-c4ed81141fe6 tempest-GroupSnapshotsV319Test-2043529679 None] Created volume successfully. Jul 10 00:30:50 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.d3fc9f5c-ca04-4157-9fb8-d9e30c12e2f9" returned: 0 in 0.911s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.d3fc9f5c-ca04-4157-9fb8-d9e30c12e2f9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:50 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936 Jul 10 00:30:50 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:50 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.d3fc9f5c-ca04-4157-9fb8-d9e30c12e2f9 Jul 10 00:30:50 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:50 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-68aacc0c-ce66-46eb-a58c-365d6dc7e459 tempest-GroupsV314Test-1493574555 None] Group tempest-GroupsV314Test-Group-1054039464: creating Jul 10 00:30:50 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-68aacc0c-ce66-46eb-a58c-365d6dc7e459 tempest-GroupsV314Test-1493574555 None] Group tempest-GroupsV314Test-Group-1054039464: created successfully Jul 10 00:30:50 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-68aacc0c-ce66-46eb-a58c-365d6dc7e459 tempest-GroupsV314Test-1493574555 None] Create group completed successfully. Jul 10 00:30:50 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d.d3fc9f5c-ca04-4157-9fb8-d9e30c12e2f9" returned: 0 in 0.731s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:51 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-d3fc9f5c-ca04-4157-9fb8-d9e30c12e2f9" released by "_delete_snapshot" :: held 3.456s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:51 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d" released by "delete_snapshot" :: held 3.483s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:51 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bf973325-c8af-4b3b-b6dd-3c51d56b81c8 tempest-VolumesDeleteCascade-469997548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936" returned: 0 in 0.912s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-bf973325-c8af-4b3b-b6dd-3c51d56b81c8 tempest-VolumesDeleteCascade-469997548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:30:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bf973325-c8af-4b3b-b6dd-3c51d56b81c8 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.b248d00c-2063-410c-8efc-6ee431bf64f2 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:51 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.b248d00c-2063-410c-8efc-6ee431bf64f2 1G Jul 10 00:30:51 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:51 devstack cinder-volume[88119]: WARNING cinder.quota [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-499065389 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-499065389, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:30:51 devstack cinder-volume[88119]: WARNING cinder.quota [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-499065389 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-499065389, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:30:51 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-629b423c-b847-4cbb-9ade-fd850c575f22 tempest-GroupSnapshotsV319Test-2043529679 None] GroupSnapshot 7fab123c-8ebb-4627-b386-83e738b3e021: creating. Jul 10 00:30:51 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Created reservations ['0f05e7ef-2676-447a-b89b-d8293e87a36c', 'f706dc50-b5e9-41de-b331-764e47a94493', '9bde63f2-15b6-4b1f-a50f-0248c51db9e2', '932a4369-287b-497b-a720-191bd335f91d'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:30:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-629b423c-b847-4cbb-9ade-fd850c575f22 tempest-GroupSnapshotsV319Test-2043529679 None] Group snapshot 7fab123c-8ebb-4627-b386-83e738b3e021: creating. {{(pid=88119) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jul 10 00:30:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-629b423c-b847-4cbb-9ade-fd850c575f22 tempest-GroupSnapshotsV319Test-2043529679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:51 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] Created reservations ['4c0f063d-02f2-43fc-9d18-2701f5dff9a3', 'b9f59af2-a0aa-4e7b-a9b5-8cc0c52b0242', 'abe634e1-e4ea-4d50-975a-4f2cba548c3c', 'b4d30362-7581-4d2b-811a-5921d715a590'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:30:51 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-3e00c27b-d556-444e-b375-39eec5b0000a tempest-GroupSnapshotsTest-103019903 None] group_snapshot 1b216f2a-9d4c-4583-8d59-bee2ec2515ad: deleted successfully Jul 10 00:30:52 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bf973325-c8af-4b3b-b6dd-3c51d56b81c8 tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.b248d00c-2063-410c-8efc-6ee431bf64f2 1G" returned: 0 in 1.010s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bf973325-c8af-4b3b-b6dd-3c51d56b81c8 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.b248d00c-2063-410c-8efc-6ee431bf64f2 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:52 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.b248d00c-2063-410c-8efc-6ee431bf64f2 Jul 10 00:30:52 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "cinder-quobyte-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d" acquired by "delete_volume" :: waited 0.042s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:52 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6679a3-41fd-4b55-80ac-bb434ea1498a]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:52 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d Jul 10 00:30:52 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:52 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:30:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Flow 'volume_create_manager' (16354ff2-e348-435f-a949-7555cb4c57fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:30:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e6c083b-1dd8-4983-b478-0b4d87f8c8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e6c083b-1dd8-4983-b478-0b4d87f8c8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1948028193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2fc84364-4ea3-4c73-8bf3-deb41c047a2e,host='devstack@QuobyteHD#QuobyteHD',id=a5f30a62-8e88-4c57-8efd-6fd0a22f9801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7810e7a98b634a13b0dc73c304b81cbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:30:52Z,use_quota=True,user_id='cd48b676bf594d779a7580e25fb56028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1a7612d-7cfd-4fa8-a4b8-f2d25447a8a1),volume_type_id=d1a7612d-7cfd-4fa8-a4b8-f2d25447a8a1)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e76c8b-d999-4fe9-b0c1-427b44e76e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e76c8b-d999-4fe9-b0c1-427b44e76e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e247bf-eec8-4d31-8f20-a63a7e63a9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e247bf-eec8-4d31-8f20-a63a7e63a9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5f30a62-8e88-4c57-8efd-6fd0a22f9801', 'volume_name': 'volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31719bf-1acc-46ad-a2b0-25a0c3dd1984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31719bf-1acc-46ad-a2b0-25a0c3dd1984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc1a4cb4-d8a1-4707-879a-eb4be510d6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:52 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Volume a5f30a62-8e88-4c57-8efd-6fd0a22f9801: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801', 'volume_size': 1} Jul 10 00:30:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:52 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bf973325-c8af-4b3b-b6dd-3c51d56b81c8 tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.b248d00c-2063-410c-8efc-6ee431bf64f2" returned: 0 in 0.853s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:52 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-bf973325-c8af-4b3b-b6dd-3c51d56b81c8 tempest-VolumesDeleteCascade-469997548 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.b248d00c-2063-410c-8efc-6ee431bf64f2 is being set with open permissions: ugo+rw Jul 10 00:30:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bf973325-c8af-4b3b-b6dd-3c51d56b81c8 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.b248d00c-2063-410c-8efc-6ee431bf64f2 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:52 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.b248d00c-2063-410c-8efc-6ee431bf64f2 Jul 10 00:30:52 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:53 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d" returned: 0 in 0.915s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:53 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d Jul 10 00:30:53 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:53 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bf973325-c8af-4b3b-b6dd-3c51d56b81c8 tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.b248d00c-2063-410c-8efc-6ee431bf64f2" returned: 0 in 0.718s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-bf973325-c8af-4b3b-b6dd-3c51d56b81c8 tempest-VolumesDeleteCascade-469997548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.629s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-629b423c-b847-4cbb-9ade-fd850c575f22 tempest-GroupSnapshotsV319Test-2043529679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.510s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-629b423c-b847-4cbb-9ade-fd850c575f22 tempest-GroupSnapshotsV319Test-2043529679 None] Creating offline snapshot f2f6a11b-f237-4eb5-a886-1eff764869b4 of volume 79563bd3-a6da-49cc-a5d7-0d27fff4ce06 {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:30:53 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-bf973325-c8af-4b3b-b6dd-3c51d56b81c8 tempest-VolumesDeleteCascade-469997548 None] Create snapshot completed successfully Jul 10 00:30:53 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fde1a15-8ecd-486a-9a3e-e324c80816a0]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-629b423c-b847-4cbb-9ade-fd850c575f22 tempest-GroupSnapshotsV319Test-2043529679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:53 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06 Jul 10 00:30:53 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:53 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d" returned: 0 in 0.707s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-d8d18fb3-a9bf-4b32-ba0b-3ad650ddb13d" released by "delete_volume" :: held 1.703s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "cinder-quobyte-da750728-da72-4a2a-9825-f61f34656ec4" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-da750728-da72-4a2a-9825-f61f34656ec4" acquired by "delete_volume" :: waited 0.014s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:53 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3cca9d-1a21-4a8c-b135-7cc7a651c155]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:54 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4 Jul 10 00:30:54 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:54 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-629b423c-b847-4cbb-9ade-fd850c575f22 tempest-GroupSnapshotsV319Test-2043529679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06" returned: 0 in 0.813s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-629b423c-b847-4cbb-9ade-fd850c575f22 tempest-GroupSnapshotsV319Test-2043529679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.f2f6a11b-f237-4eb5-a886-1eff764869b4 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:54 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.f2f6a11b-f237-4eb5-a886-1eff764869b4 1G Jul 10 00:30:54 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:54 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "cinder-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4" returned: 0 in 0.871s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:54 devstack sudo[97685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4 Jul 10 00:30:54 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Performing cascade delete. {{(pid=88119) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 10 00:30:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "cinder-1ddeadd6-cf7e-43f6-8960-5f040e150936-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-1ddeadd6-cf7e-43f6-8960-5f040e150936-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "cinder-quobyte-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-quobyte-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "cinder-quobyte-1ddeadd6-cf7e-43f6-8960-5f040e150936" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:55 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-quobyte-1ddeadd6-cf7e-43f6-8960-5f040e150936" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:55 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Deleting offline snapshot 1ddeadd6-cf7e-43f6-8960-5f040e150936 of volume 4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:30:55 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] snapshot_file for this snap is: volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:30:55 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef16703c-1a1c-4f81-80a7-d5e22689345a]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:55 devstack sudo[97687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936 Jul 10 00:30:55 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:55 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-629b423c-b847-4cbb-9ade-fd850c575f22 tempest-GroupSnapshotsV319Test-2043529679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.f2f6a11b-f237-4eb5-a886-1eff764869b4 1G" returned: 0 in 0.917s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-629b423c-b847-4cbb-9ade-fd850c575f22 tempest-GroupSnapshotsV319Test-2043529679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.f2f6a11b-f237-4eb5-a886-1eff764869b4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:55 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.f2f6a11b-f237-4eb5-a886-1eff764869b4 Jul 10 00:30:55 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:55 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-da750728-da72-4a2a-9825-f61f34656ec4" returned: 0 in 0.782s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:55 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-da750728-da72-4a2a-9825-f61f34656ec4" released by "delete_volume" :: held 1.718s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:30:55 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] Created reservations ['aa911a8c-9325-4c36-85ef-e94a9c378134'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:30:55 devstack cinder-volume[88119]: WARNING cinder.quota [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-499065389 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-499065389, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:30:55 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] Created reservations ['84ba67e9-5a2e-446f-8b5c-8fb6e0138b13', '189ed852-588f-4d0c-aaeb-b761a8bbae06', '0d633676-1c2d-48cf-a727-b1f590247a02', '950c76b5-058f-41f8-8260-4b5853d42c7b'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:30:55 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] Created reservations ['806013a3-715d-41c1-aa78-23d1b9f577a2', '87217f43-2195-42be-9360-aa4bab6b659a', 'ecece9c1-80b2-490d-936c-04dd405e72c7', '113db730-bf21-4e79-a84d-2db89ed78ae8'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:30:55 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936" returned: 0 in 0.952s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:30:56 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dceef0a-451c-4179-afbd-3c30396de448]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:30:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:30:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:56 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:30:56 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:56 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d Jul 10 00:30:56 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:56 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-629b423c-b847-4cbb-9ade-fd850c575f22 tempest-GroupSnapshotsV319Test-2043529679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.f2f6a11b-f237-4eb5-a886-1eff764869b4" returned: 0 in 0.785s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:56 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-629b423c-b847-4cbb-9ade-fd850c575f22 tempest-GroupSnapshotsV319Test-2043529679 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.f2f6a11b-f237-4eb5-a886-1eff764869b4 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:30:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-629b423c-b847-4cbb-9ade-fd850c575f22 tempest-GroupSnapshotsV319Test-2043529679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.f2f6a11b-f237-4eb5-a886-1eff764869b4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:56 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.f2f6a11b-f237-4eb5-a886-1eff764869b4 Jul 10 00:30:56 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:56 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.698s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:56 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:30:56 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-240b6d5d-87f7-49e5-9030-eec1620186f6 tempest-GroupSnapshotsTest-103019903 None] Delete group completed successfully. Jul 10 00:30:56 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d" returned: 0 in 0.830s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:56 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9054b0-d544-4302-9fd4-afc94c3475bd]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.b248d00c-2063-410c-8efc-6ee431bf64f2 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:56 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-629b423c-b847-4cbb-9ade-fd850c575f22 tempest-GroupSnapshotsV319Test-2043529679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.f2f6a11b-f237-4eb5-a886-1eff764869b4" returned: 0 in 0.721s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-629b423c-b847-4cbb-9ade-fd850c575f22 tempest-GroupSnapshotsV319Test-2043529679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:57 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.info Jul 10 00:30:57 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:57 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.b248d00c-2063-410c-8efc-6ee431bf64f2 Jul 10 00:30:57 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:57 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-20304eb9-e941-4cc5-9257-73e68a4836a2 tempest-GroupSnapshotsTest-103019903 None] Group tempest-GroupSnapshotsTest-Group-607751216: creating Jul 10 00:30:57 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-20304eb9-e941-4cc5-9257-73e68a4836a2 tempest-GroupSnapshotsTest-103019903 None] Group tempest-GroupSnapshotsTest-Group-607751216: created successfully Jul 10 00:30:57 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-20304eb9-e941-4cc5-9257-73e68a4836a2 tempest-GroupSnapshotsTest-103019903 None] Create group completed successfully. Jul 10 00:30:57 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.b248d00c-2063-410c-8efc-6ee431bf64f2" returned: 0 in 0.829s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:57 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:30:57 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-629b423c-b847-4cbb-9ade-fd850c575f22 tempest-GroupSnapshotsV319Test-2043529679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.info" returned: 0 in 0.761s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:57 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-629b423c-b847-4cbb-9ade-fd850c575f22 tempest-GroupSnapshotsV319Test-2043529679 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:30:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-629b423c-b847-4cbb-9ade-fd850c575f22 tempest-GroupSnapshotsV319Test-2043529679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:57 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[40028317-0328-4f68-b4f6-1f9653a26f23]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:57 devstack sudo[97722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.info Jul 10 00:30:57 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:57 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936 Jul 10 00:30:57 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:58 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-629b423c-b847-4cbb-9ade-fd850c575f22 tempest-GroupSnapshotsV319Test-2043529679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.info" returned: 0 in 0.664s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-629b423c-b847-4cbb-9ade-fd850c575f22 tempest-GroupSnapshotsV319Test-2043529679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.768s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.828s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2fc84364-4ea3-4c73-8bf3-deb41c047a2e,created_at=2026-07-09T22:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1948028193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2fc84364-4ea3-4c73-8bf3-deb41c047a2e,host='devstack@QuobyteHD#QuobyteHD',id=a5f30a62-8e88-4c57-8efd-6fd0a22f9801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7810e7a98b634a13b0dc73c304b81cbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:30:52Z,use_quota=True,user_id='cd48b676bf594d779a7580e25fb56028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1a7612d-7cfd-4fa8-a4b8-f2d25447a8a1),volume_type_id=d1a7612d-7cfd-4fa8-a4b8-f2d25447a8a1)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:30:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Creating volume a5f30a62-8e88-4c57-8efd-6fd0a22f9801 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:30:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:30:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:30:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:30:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:30:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:30:58 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:30:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:58 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801 1073741824 Jul 10 00:30:58 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:58 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-629b423c-b847-4cbb-9ade-fd850c575f22 tempest-GroupSnapshotsV319Test-2043529679 None] group_snapshot 7fab123c-8ebb-4627-b386-83e738b3e021: created successfully Jul 10 00:30:58 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936" returned: 0 in 0.831s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:30:58 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f0a3f9-47f8-43bb-9649-ad039a89df8f]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:58 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d Jul 10 00:30:58 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:59 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-d69eb4a0-a39c-4dec-a08b-8564853fa091 tempest-GroupSnapshotsV319Test-2043529679 None] group_snapshot 7fab123c-8ebb-4627-b386-83e738b3e021: deleting Jul 10 00:30:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d69eb4a0-a39c-4dec-a08b-8564853fa091 tempest-GroupSnapshotsV319Test-2043529679 None] group_snapshot 7fab123c-8ebb-4627-b386-83e738b3e021: deleting {{(pid=88119) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jul 10 00:30:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d69eb4a0-a39c-4dec-a08b-8564853fa091 tempest-GroupSnapshotsV319Test-2043529679 None] Acquiring lock "cinder-quobyte-79563bd3-a6da-49cc-a5d7-0d27fff4ce06" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d69eb4a0-a39c-4dec-a08b-8564853fa091 tempest-GroupSnapshotsV319Test-2043529679 None] Lock "cinder-quobyte-79563bd3-a6da-49cc-a5d7-0d27fff4ce06" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d69eb4a0-a39c-4dec-a08b-8564853fa091 tempest-GroupSnapshotsV319Test-2043529679 None] Acquiring lock "cinder-quobyte-f2f6a11b-f237-4eb5-a886-1eff764869b4" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:30:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d69eb4a0-a39c-4dec-a08b-8564853fa091 tempest-GroupSnapshotsV319Test-2043529679 None] Lock "cinder-quobyte-f2f6a11b-f237-4eb5-a886-1eff764869b4" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:30:59 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-d69eb4a0-a39c-4dec-a08b-8564853fa091 tempest-GroupSnapshotsV319Test-2043529679 None] Deleting offline snapshot f2f6a11b-f237-4eb5-a886-1eff764869b4 of volume 79563bd3-a6da-49cc-a5d7-0d27fff4ce06 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:30:59 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-d69eb4a0-a39c-4dec-a08b-8564853fa091 tempest-GroupSnapshotsV319Test-2043529679 None] snapshot_file for this snap is: volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.f2f6a11b-f237-4eb5-a886-1eff764869b4 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:30:59 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a012480-6d43-4846-8517-cbfee05acda3]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:30:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d69eb4a0-a39c-4dec-a08b-8564853fa091 tempest-GroupSnapshotsV319Test-2043529679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.f2f6a11b-f237-4eb5-a886-1eff764869b4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:59 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:30:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Flow 'volume_create_manager' (68315beb-fc71-433a-b338-c499e476bc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:30:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18c91c4-70dd-478a-b656-b28abc5c34b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:59 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.f2f6a11b-f237-4eb5-a886-1eff764869b4 Jul 10 00:30:59 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18c91c4-70dd-478a-b656-b28abc5c34b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-562018558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a7ff1420-a969-4227-8dad-12323319e6b4,host='devstack@QuobyteHD#QuobyteHD',id=59b16cbd-cc9d-4390-801b-5d4c7148fb5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfeb9ad7d9a1491db2b0bab27b2d61e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:30:59Z,use_quota=True,user_id='8253e96f724d430f8fab1cb90d9aa3c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c8fd741-d17a-4aaf-bd23-49f328dfdbc3),volume_type_id=1c8fd741-d17a-4aaf-bd23-49f328dfdbc3)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ea8b4b-460b-4d3d-a868-adb0a16ab9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ea8b4b-460b-4d3d-a868-adb0a16ab9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df51194-33d3-4c36-877e-fb78cd82b2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df51194-33d3-4c36-877e-fb78cd82b2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59b16cbd-cc9d-4390-801b-5d4c7148fb5c', 'volume_name': 'volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf01ea9-480d-44bb-b747-c9514ca0e808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf01ea9-480d-44bb-b747-c9514ca0e808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:30:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd0c89fb-ea54-48ff-a943-26a47511ca1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:30:59 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Volume 59b16cbd-cc9d-4390-801b-5d4c7148fb5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c', 'volume_size': 1} Jul 10 00:30:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:30:59 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801 1073741824" returned: 0 in 1.113s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:59 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801 Jul 10 00:30:59 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:30:59 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Jul 10 00:30:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d" returned: 0 in 1.118s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:30:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:30:59 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936 Jul 10 00:30:59 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:00 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d69eb4a0-a39c-4dec-a08b-8564853fa091 tempest-GroupSnapshotsV319Test-2043529679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.f2f6a11b-f237-4eb5-a886-1eff764869b4" returned: 0 in 0.834s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-d69eb4a0-a39c-4dec-a08b-8564853fa091 tempest-GroupSnapshotsV319Test-2043529679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:31:00 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9ee2f0-6198-40d0-8bc8-1b0b47516aaf]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d69eb4a0-a39c-4dec-a08b-8564853fa091 tempest-GroupSnapshotsV319Test-2043529679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:00 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801" returned: 0 in 0.705s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] <== create_volume: return (1865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:31:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.773s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a7ff1420-a969-4227-8dad-12323319e6b4,created_at=2026-07-09T22:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-562018558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a7ff1420-a969-4227-8dad-12323319e6b4,host='devstack@QuobyteHD#QuobyteHD',id=59b16cbd-cc9d-4390-801b-5d4c7148fb5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfeb9ad7d9a1491db2b0bab27b2d61e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:30:59Z,use_quota=True,user_id='8253e96f724d430f8fab1cb90d9aa3c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c8fd741-d17a-4aaf-bd23-49f328dfdbc3),volume_type_id=1c8fd741-d17a-4aaf-bd23-49f328dfdbc3)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:31:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Creating volume 59b16cbd-cc9d-4390-801b-5d4c7148fb5c {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:31:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:31:00 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:31:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:00 devstack sudo[97752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06 Jul 10 00:31:00 devstack sudo[97752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc1a4cb4-d8a1-4707-879a-eb4be510d6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:00 devstack sudo[97756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c 1073741824 Jul 10 00:31:00 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34fe4d65-b65f-4af8-a85a-a135f368a7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:00 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Volume volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801 (a5f30a62-8e88-4c57-8efd-6fd0a22f9801): created successfully Jul 10 00:31:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34fe4d65-b65f-4af8-a85a-a135f368a7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Flow 'volume_create_manager' (16354ff2-e348-435f-a949-7555cb4c57fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:31:00 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-b10a4980-2b20-49a8-97d7-5d7ebc4fa90d tempest-GroupsV314Test-1493574555 None] Created volume successfully. Jul 10 00:31:00 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936" returned: 0 in 0.878s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:00 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936 Jul 10 00:31:00 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:01 devstack sudo[97752]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d69eb4a0-a39c-4dec-a08b-8564853fa091 tempest-GroupSnapshotsV319Test-2043529679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06" returned: 0 in 0.883s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d69eb4a0-a39c-4dec-a08b-8564853fa091 tempest-GroupSnapshotsV319Test-2043529679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.f2f6a11b-f237-4eb5-a886-1eff764869b4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:01 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.f2f6a11b-f237-4eb5-a886-1eff764869b4 Jul 10 00:31:01 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:01 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c 1073741824" returned: 0 in 0.954s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:01 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.1ddeadd6-cf7e-43f6-8960-5f040e150936" returned: 0 in 0.708s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.b248d00c-2063-410c-8efc-6ee431bf64f2 -F qcow2 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:01 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.b248d00c-2063-410c-8efc-6ee431bf64f2 -F qcow2 Jul 10 00:31:01 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:01 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c Jul 10 00:31:01 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:01 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d69eb4a0-a39c-4dec-a08b-8564853fa091 tempest-GroupSnapshotsV319Test-2043529679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.f2f6a11b-f237-4eb5-a886-1eff764869b4" returned: 0 in 0.851s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d69eb4a0-a39c-4dec-a08b-8564853fa091 tempest-GroupSnapshotsV319Test-2043529679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.f2f6a11b-f237-4eb5-a886-1eff764869b4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:01 devstack sudo[97779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.f2f6a11b-f237-4eb5-a886-1eff764869b4 Jul 10 00:31:01 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:02 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c" returned: 0 in 0.790s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.063s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:02 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Cloning volume a5f30a62-8e88-4c57-8efd-6fd0a22f9801 to volume 582fb024-c20d-4c3e-bef9-4a18662081e7 Jul 10 00:31:02 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.b248d00c-2063-410c-8efc-6ee431bf64f2 -F qcow2" returned: 0 in 0.839s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd0c89fb-ea54-48ff-a943-26a47511ca1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2a3fa7d-1b54-4825-a074-bb3b5533b6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-quobyte-1ddeadd6-cf7e-43f6-8960-5f040e150936" released by "_delete_snapshot" :: held 7.230s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:02 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Volume volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c (59b16cbd-cc9d-4390-801b-5d4c7148fb5c): created successfully Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2a3fa7d-1b54-4825-a074-bb3b5533b6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Flow 'volume_create_manager' (68315beb-fc71-433a-b338-c499e476bc7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-quobyte-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d" released by "delete_snapshot" :: held 7.290s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Creating offline snapshot c181d289-cf08-4c8a-a137-808fffc99578 of volume a5f30a62-8e88-4c57-8efd-6fd0a22f9801 {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:31:02 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-a6889cd2-340e-485a-a248-85d214056424 tempest-GroupSnapshotsTest-103019903 None] Created volume successfully. Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[16356879-5be7-461e-9654-55516873ecea]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Created reservations ['16535aa2-8f7c-45e5-b504-6274b8f8b834', '2b0b1827-2e00-4b8f-9a10-d961efcc3eda', '0219b288-adec-4eac-9b59-777ca17029fb', '2ec33e3a-1f53-4cd3-aacf-c7d8387b25f2'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:02 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801 Jul 10 00:31:02 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:02 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Delete snapshot completed successfully. Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-1ddeadd6-cf7e-43f6-8960-5f040e150936-delete_snapshot" released by "delete_snapshot" :: held 7.594s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "cinder-b248d00c-2063-410c-8efc-6ee431bf64f2-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-b248d00c-2063-410c-8efc-6ee431bf64f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "cinder-quobyte-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-quobyte-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "cinder-quobyte-b248d00c-2063-410c-8efc-6ee431bf64f2" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-quobyte-b248d00c-2063-410c-8efc-6ee431bf64f2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Deleting offline snapshot b248d00c-2063-410c-8efc-6ee431bf64f2 of volume 4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] snapshot_file for this snap is: volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.b248d00c-2063-410c-8efc-6ee431bf64f2 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[3360c6fc-8a5a-4fd6-bb0b-f8b3295e910f]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.b248d00c-2063-410c-8efc-6ee431bf64f2 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:02 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.b248d00c-2063-410c-8efc-6ee431bf64f2 Jul 10 00:31:02 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:02 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d69eb4a0-a39c-4dec-a08b-8564853fa091 tempest-GroupSnapshotsV319Test-2043529679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06.f2f6a11b-f237-4eb5-a886-1eff764869b4" returned: 0 in 0.847s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d69eb4a0-a39c-4dec-a08b-8564853fa091 tempest-GroupSnapshotsV319Test-2043529679 None] Lock "cinder-quobyte-f2f6a11b-f237-4eb5-a886-1eff764869b4" released by "_delete_snapshot" :: held 3.551s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d69eb4a0-a39c-4dec-a08b-8564853fa091 tempest-GroupSnapshotsV319Test-2043529679 None] Lock "cinder-quobyte-79563bd3-a6da-49cc-a5d7-0d27fff4ce06" released by "delete_snapshot" :: held 3.588s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:02 devstack cinder-volume[88119]: WARNING cinder.quota [None req-d69eb4a0-a39c-4dec-a08b-8564853fa091 tempest-GroupSnapshotsV319Test-2043529679 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1794454336 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1794454336, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:31:02 devstack cinder-volume[88119]: WARNING cinder.quota [None req-d69eb4a0-a39c-4dec-a08b-8564853fa091 tempest-GroupSnapshotsV319Test-2043529679 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1794454336 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1794454336, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:31:02 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-d69eb4a0-a39c-4dec-a08b-8564853fa091 tempest-GroupSnapshotsV319Test-2043529679 None] Created reservations ['d50e064b-47f9-4317-8848-83cc76c504ff', 'ef094d14-6668-4d7a-8a2c-0c29f09a7512', '9581b0d0-bf4b-4f71-91d5-2aef99e848ce', '564971ff-f562-4d62-9729-b8b3c41b54e4'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:03 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-d69eb4a0-a39c-4dec-a08b-8564853fa091 tempest-GroupSnapshotsV319Test-2043529679 None] group_snapshot 7fab123c-8ebb-4627-b386-83e738b3e021: deleted successfully Jul 10 00:31:03 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801" returned: 0 in 0.889s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.c181d289-cf08-4c8a-a137-808fffc99578 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:03 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-66b87cd5-853c-4b48-bad9-34d490798209 tempest-GroupSnapshotsTest-103019903 None] GroupSnapshot 1b7cd7e8-83e2-4c59-bd5e-3cf4f745e77f: creating. Jul 10 00:31:03 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.c181d289-cf08-4c8a-a137-808fffc99578 1G Jul 10 00:31:03 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-66b87cd5-853c-4b48-bad9-34d490798209 tempest-GroupSnapshotsTest-103019903 None] Group snapshot 1b7cd7e8-83e2-4c59-bd5e-3cf4f745e77f: creating. {{(pid=88119) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4176}} Jul 10 00:31:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-66b87cd5-853c-4b48-bad9-34d490798209 tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:03 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.b248d00c-2063-410c-8efc-6ee431bf64f2" returned: 0 in 0.883s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:31:03 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d1fafa-a0e8-415c-8fb6-8e4c5a3487cd]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:03 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d Jul 10 00:31:03 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:03 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-24af0697-e9d0-4ba8-aa35-205f004c6d1e tempest-GroupSnapshotsV319Test-2043529679 None] Acquiring lock "cinder-quobyte-79563bd3-a6da-49cc-a5d7-0d27fff4ce06" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-24af0697-e9d0-4ba8-aa35-205f004c6d1e tempest-GroupSnapshotsV319Test-2043529679 None] Lock "cinder-quobyte-79563bd3-a6da-49cc-a5d7-0d27fff4ce06" acquired by "delete_volume" :: waited 0.021s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:04 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e598c4-8589-4c85-80b8-2b692b75c711]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-24af0697-e9d0-4ba8-aa35-205f004c6d1e tempest-GroupSnapshotsV319Test-2043529679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:04 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:04 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06 Jul 10 00:31:04 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.c181d289-cf08-4c8a-a137-808fffc99578 1G" returned: 0 in 0.906s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.c181d289-cf08-4c8a-a137-808fffc99578 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:04 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.c181d289-cf08-4c8a-a137-808fffc99578 Jul 10 00:31:04 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:04 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d" returned: 0 in 0.843s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.b248d00c-2063-410c-8efc-6ee431bf64f2 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:04 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.b248d00c-2063-410c-8efc-6ee431bf64f2 Jul 10 00:31:04 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:04 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-24af0697-e9d0-4ba8-aa35-205f004c6d1e tempest-GroupSnapshotsV319Test-2043529679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06" returned: 0 in 0.850s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-24af0697-e9d0-4ba8-aa35-205f004c6d1e tempest-GroupSnapshotsV319Test-2043529679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:04 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.c181d289-cf08-4c8a-a137-808fffc99578" returned: 0 in 0.752s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:04 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.c181d289-cf08-4c8a-a137-808fffc99578 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:31:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.c181d289-cf08-4c8a-a137-808fffc99578 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:04 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06 Jul 10 00:31:04 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:04 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.c181d289-cf08-4c8a-a137-808fffc99578 Jul 10 00:31:04 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:05 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.b248d00c-2063-410c-8efc-6ee431bf64f2" returned: 0 in 0.826s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.b248d00c-2063-410c-8efc-6ee431bf64f2 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:05 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.b248d00c-2063-410c-8efc-6ee431bf64f2 Jul 10 00:31:05 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:05 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-24af0697-e9d0-4ba8-aa35-205f004c6d1e tempest-GroupSnapshotsV319Test-2043529679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-79563bd3-a6da-49cc-a5d7-0d27fff4ce06" returned: 0 in 0.775s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:05 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-24af0697-e9d0-4ba8-aa35-205f004c6d1e tempest-GroupSnapshotsV319Test-2043529679 None] Lock "cinder-quobyte-79563bd3-a6da-49cc-a5d7-0d27fff4ce06" released by "delete_volume" :: held 1.685s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.c181d289-cf08-4c8a-a137-808fffc99578" returned: 0 in 0.780s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:05 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.info Jul 10 00:31:05 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:05 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-24af0697-e9d0-4ba8-aa35-205f004c6d1e tempest-GroupSnapshotsV319Test-2043529679 None] Created reservations ['18ec283c-fa71-4c26-ace3-19c592a2ad2d'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:05 devstack cinder-volume[88119]: WARNING cinder.quota [None req-24af0697-e9d0-4ba8-aa35-205f004c6d1e tempest-GroupSnapshotsV319Test-2043529679 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1794454336 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1794454336, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:31:05 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-24af0697-e9d0-4ba8-aa35-205f004c6d1e tempest-GroupSnapshotsV319Test-2043529679 None] Created reservations ['c1dbb361-a467-464d-808f-f84a87a1dfa0', '9388709b-bef6-4e6f-9bf5-1435916ed7cc', '6d76fba7-e9ab-4387-ad51-cd7ba728e138', '2bc17be7-d111-4b51-a11d-63e9d8692517'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:05 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d.b248d00c-2063-410c-8efc-6ee431bf64f2" returned: 0 in 0.689s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-quobyte-b248d00c-2063-410c-8efc-6ee431bf64f2" released by "_delete_snapshot" :: held 3.368s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-quobyte-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d" released by "delete_snapshot" :: held 3.401s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-24af0697-e9d0-4ba8-aa35-205f004c6d1e tempest-GroupSnapshotsV319Test-2043529679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-24af0697-e9d0-4ba8-aa35-205f004c6d1e tempest-GroupSnapshotsV319Test-2043529679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:06 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-24af0697-e9d0-4ba8-aa35-205f004c6d1e tempest-GroupSnapshotsV319Test-2043529679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:06 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-24af0697-e9d0-4ba8-aa35-205f004c6d1e tempest-GroupSnapshotsV319Test-2043529679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-24af0697-e9d0-4ba8-aa35-205f004c6d1e tempest-GroupSnapshotsV319Test-2043529679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-24af0697-e9d0-4ba8-aa35-205f004c6d1e tempest-GroupSnapshotsV319Test-2043529679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:06 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:31:06 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:06 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Created reservations ['2d394504-230d-4f84-92f4-e9a6723b406b', '5cd916d1-cb22-4be7-a54e-9cde4309c79c', '17c07967-9d13-4b62-8b8e-6b5032d24df8', 'c5c06bd7-5198-4f0d-a0f9-a246abe1a06f'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:06 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Delete snapshot completed successfully. Jul 10 00:31:06 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-b248d00c-2063-410c-8efc-6ee431bf64f2-delete_snapshot" released by "delete_snapshot" :: held 3.579s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:06 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Snapshots deleted, issuing volume delete {{(pid=88119) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 10 00:31:06 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "cinder-quobyte-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:06 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-quobyte-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d" acquired by "delete_volume" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:06 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dda172-05ce-4e87-8a18-fdfa69149ed3]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:06 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d Jul 10 00:31:06 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:06 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.info" returned: 0 in 0.796s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:06 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:31:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:06 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.info Jul 10 00:31:06 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:06 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-24af0697-e9d0-4ba8-aa35-205f004c6d1e tempest-GroupSnapshotsV319Test-2043529679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.793s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:06 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-24af0697-e9d0-4ba8-aa35-205f004c6d1e tempest-GroupSnapshotsV319Test-2043529679 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:31:06 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-24af0697-e9d0-4ba8-aa35-205f004c6d1e tempest-GroupSnapshotsV319Test-2043529679 None] Delete group completed successfully. Jul 10 00:31:07 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d" returned: 0 in 0.878s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:07 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d Jul 10 00:31:07 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:07 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.info" returned: 0 in 0.717s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Acquiring lock "cinder-quobyte-582fb024-c20d-4c3e-bef9-4a18662081e7" by "_copy_volume_from_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Lock "cinder-quobyte-582fb024-c20d-4c3e-bef9-4a18662081e7" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] snapshot: c181d289-cf08-4c8a-a137-808fffc99578, volume: 582fb024-c20d-4c3e-bef9-4a18662081e7, {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 00:31:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:07 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc17e90-cf0c-4b6a-aec3-235b1c3ec033]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.c181d289-cf08-4c8a-a137-808fffc99578 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:07 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.c181d289-cf08-4c8a-a137-808fffc99578 Jul 10 00:31:07 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:07 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d" returned: 0 in 0.722s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-quobyte-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d" released by "delete_volume" :: held 1.667s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:07 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=162,cinder:INSERT=45,cinder:UPDATE=188,cinder:DELETE=3 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:31:07 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=160,cinder:INSERT=41,cinder:UPDATE=153,cinder:DELETE=14 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:31:07 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Created reservations ['da478eb3-5884-41a2-8ced-e49ad847212a', 'e06fb531-ba2c-4df4-84e1-eeaa79aec9ba', 'af531f53-bd89-4285-8f97-67c8b39cdfb1', '3c849548-f928-430c-97c0-c0968adba3fe'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:08 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:31:08 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:08 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.c181d289-cf08-4c8a-a137-808fffc99578" returned: 0 in 0.865s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:31:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801 {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 00:31:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Creating direct copy from snapshot {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 00:31:08 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd7f5fe-4664-401c-b24d-26f6b134b245]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:08 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801 Jul 10 00:31:08 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:08 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.741s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:08 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:31:08 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Deleted volume successfully. Jul 10 00:31:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25fdbf01-4476-4d7b-8f76-2d268f303fc0 tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-4a9f7f4f-5ddb-4864-8cbc-3512e2531f8d-delete_volume" released by "delete_volume" :: held 13.920s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:09 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801" returned: 0 in 0.985s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:09 devstack cinder-volume[88119]: DEBUG cinder.utils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Path /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-582fb024-c20d-4c3e-bef9-4a18662081e7 not found in is_blk_device check {{(pid=88119) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 00:31:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-582fb024-c20d-4c3e-bef9-4a18662081e7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:09 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-582fb024-c20d-4c3e-bef9-4a18662081e7 Jul 10 00:31:09 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:09 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:31:09 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Flow 'volume_create_manager' (904cd255-beeb-4145-b410-0ed6c8aa9faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:31:09 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b36fc2a-ad17-4508-8771-0f9102fa8a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:09 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b36fc2a-ad17-4508-8771-0f9102fa8a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1679388199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f3cf55-848d-45ab-93bc-21d43a197aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caf86e45be3d4392b06fe751144235ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:31:10Z,use_quota=True,user_id='96523657f5324cd794cb0c1fa101cb68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:09 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a6137d-f8a4-4836-a806-ee9079ad4e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:09 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a6137d-f8a4-4836-a806-ee9079ad4e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:09 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (979bc244-3d13-48d6-8f26-be3e97c89fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:09 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (979bc244-3d13-48d6-8f26-be3e97c89fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9f3cf55-848d-45ab-93bc-21d43a197aab', 'volume_name': 'volume-d9f3cf55-848d-45ab-93bc-21d43a197aab', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:09 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6595ffc8-850e-4d7c-9e3e-0c915dcc738c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:09 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6595ffc8-850e-4d7c-9e3e-0c915dcc738c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:09 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f590e82-c255-4be9-84ed-fb8b84df2361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:09 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Volume d9f3cf55-848d-45ab-93bc-21d43a197aab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9f3cf55-848d-45ab-93bc-21d43a197aab', 'volume_size': 1} Jul 10 00:31:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:14 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-582fb024-c20d-4c3e-bef9-4a18662081e7" returned: 0 in 5.341s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:14 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcd7996-7831-4c23-8f28-f814003045e2]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:14 devstack sudo[97885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801 Jul 10 00:31:14 devstack sudo[97885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:15 devstack sudo[97885]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801" returned: 0 in 0.914s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:15 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Image conversion details: src /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801, size 1024.00 MB, duration 5.34 sec, destination /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-582fb024-c20d-4c3e-bef9-4a18662081e7 {{(pid=88119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:31:15 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Converted 1024.00 MB image at 191.71 MB/s Jul 10 00:31:15 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-582fb024-c20d-4c3e-bef9-4a18662081e7 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:31:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-582fb024-c20d-4c3e-bef9-4a18662081e7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:15 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-582fb024-c20d-4c3e-bef9-4a18662081e7 Jul 10 00:31:15 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:16 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-582fb024-c20d-4c3e-bef9-4a18662081e7" returned: 0 in 0.649s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:16 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Lock "cinder-quobyte-582fb024-c20d-4c3e-bef9-4a18662081e7" released by "_copy_volume_from_snapshot" :: held 8.846s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:16 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Acquiring lock "cinder-quobyte-c181d289-cf08-4c8a-a137-808fffc99578" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:16 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Lock "cinder-quobyte-c181d289-cf08-4c8a-a137-808fffc99578" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:16 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Deleting offline snapshot c181d289-cf08-4c8a-a137-808fffc99578 of volume a5f30a62-8e88-4c57-8efd-6fd0a22f9801 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:31:16 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] snapshot_file for this snap is: volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.c181d289-cf08-4c8a-a137-808fffc99578 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:31:16 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[575021ed-6282-4ea1-81f7-3f5ae6e427c0]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.c181d289-cf08-4c8a-a137-808fffc99578 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:16 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.c181d289-cf08-4c8a-a137-808fffc99578 Jul 10 00:31:16 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:17 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.c181d289-cf08-4c8a-a137-808fffc99578" returned: 0 in 0.797s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:31:17 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f408410f-b237-43ba-b1fe-e78feb6aefb0]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:17 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801 Jul 10 00:31:17 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:17 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801" returned: 0 in 0.747s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.c181d289-cf08-4c8a-a137-808fffc99578 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:17 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.c181d289-cf08-4c8a-a137-808fffc99578 Jul 10 00:31:17 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:18 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.c181d289-cf08-4c8a-a137-808fffc99578" returned: 0 in 0.737s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.c181d289-cf08-4c8a-a137-808fffc99578 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:18 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.c181d289-cf08-4c8a-a137-808fffc99578 Jul 10 00:31:18 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:19 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801.c181d289-cf08-4c8a-a137-808fffc99578" returned: 0 in 0.662s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:19 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Lock "cinder-quobyte-c181d289-cf08-4c8a-a137-808fffc99578" released by "_delete_snapshot" :: held 3.038s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.074s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-66b87cd5-853c-4b48-bad9-34d490798209 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.917s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-66b87cd5-853c-4b48-bad9-34d490798209 tempest-GroupSnapshotsTest-103019903 None] Creating offline snapshot b6bcd962-e338-4c9c-86ee-72bb6b918755 of volume 59b16cbd-cc9d-4390-801b-5d4c7148fb5c {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:31:19 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5746f82-ca68-49ec-aac1-b2c5050773e5]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-66b87cd5-853c-4b48-bad9-34d490798209 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:19 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-40ccdc75-eb02-4299-bc1a-36f8d34e7d00 tempest-GroupsV314Test-1493574555 None] Create group from source-group-2fc84364-4ea3-4c73-8bf3-deb41c047a2e completed successfully. Jul 10 00:31:19 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c Jul 10 00:31:19 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:20 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-66b87cd5-853c-4b48-bad9-34d490798209 tempest-GroupSnapshotsTest-103019903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c" returned: 0 in 0.845s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-66b87cd5-853c-4b48-bad9-34d490798209 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.b6bcd962-e338-4c9c-86ee-72bb6b918755 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:20 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.b6bcd962-e338-4c9c-86ee-72bb6b918755 1G Jul 10 00:31:20 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-edc342dc-0315-4d8a-8711-dd6debaf9c56 tempest-GroupsV314Test-1493574555 None] Acquiring lock "cinder-quobyte-582fb024-c20d-4c3e-bef9-4a18662081e7" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-edc342dc-0315-4d8a-8711-dd6debaf9c56 tempest-GroupsV314Test-1493574555 None] Lock "cinder-quobyte-582fb024-c20d-4c3e-bef9-4a18662081e7" acquired by "delete_volume" :: waited 0.024s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:20 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f3e38b-7ffd-411e-bbb6-0f9e67a58718]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-edc342dc-0315-4d8a-8711-dd6debaf9c56 tempest-GroupsV314Test-1493574555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-582fb024-c20d-4c3e-bef9-4a18662081e7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:20 devstack sudo[97920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-582fb024-c20d-4c3e-bef9-4a18662081e7 Jul 10 00:31:20 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:21 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-66b87cd5-853c-4b48-bad9-34d490798209 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.b6bcd962-e338-4c9c-86ee-72bb6b918755 1G" returned: 0 in 0.955s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-66b87cd5-853c-4b48-bad9-34d490798209 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.b6bcd962-e338-4c9c-86ee-72bb6b918755 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:21 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.b6bcd962-e338-4c9c-86ee-72bb6b918755 Jul 10 00:31:21 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:21 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-edc342dc-0315-4d8a-8711-dd6debaf9c56 tempest-GroupsV314Test-1493574555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-582fb024-c20d-4c3e-bef9-4a18662081e7" returned: 0 in 0.811s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-edc342dc-0315-4d8a-8711-dd6debaf9c56 tempest-GroupsV314Test-1493574555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-582fb024-c20d-4c3e-bef9-4a18662081e7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:21 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-582fb024-c20d-4c3e-bef9-4a18662081e7 Jul 10 00:31:21 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:21 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-66b87cd5-853c-4b48-bad9-34d490798209 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.b6bcd962-e338-4c9c-86ee-72bb6b918755" returned: 0 in 0.741s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:21 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-66b87cd5-853c-4b48-bad9-34d490798209 tempest-GroupSnapshotsTest-103019903 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.b6bcd962-e338-4c9c-86ee-72bb6b918755 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:31:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-66b87cd5-853c-4b48-bad9-34d490798209 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.b6bcd962-e338-4c9c-86ee-72bb6b918755 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:21 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-edc342dc-0315-4d8a-8711-dd6debaf9c56 tempest-GroupsV314Test-1493574555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-582fb024-c20d-4c3e-bef9-4a18662081e7" returned: 0 in 0.698s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:21 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.b6bcd962-e338-4c9c-86ee-72bb6b918755 Jul 10 00:31:21 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:21 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-edc342dc-0315-4d8a-8711-dd6debaf9c56 tempest-GroupsV314Test-1493574555 None] Lock "cinder-quobyte-582fb024-c20d-4c3e-bef9-4a18662081e7" released by "delete_volume" :: held 1.562s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:21 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-edc342dc-0315-4d8a-8711-dd6debaf9c56 tempest-GroupsV314Test-1493574555 None] Created reservations ['8b407a81-b5d1-40f5-a499-37662a501494'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:21 devstack cinder-volume[88119]: WARNING cinder.quota [None req-edc342dc-0315-4d8a-8711-dd6debaf9c56 tempest-GroupsV314Test-1493574555 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1969754437 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1969754437, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:31:21 devstack cinder-volume[88119]: WARNING cinder.quota [None req-edc342dc-0315-4d8a-8711-dd6debaf9c56 tempest-GroupsV314Test-1493574555 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1969754437 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1969754437, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:31:21 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-edc342dc-0315-4d8a-8711-dd6debaf9c56 tempest-GroupsV314Test-1493574555 None] Created reservations ['cdbf40cf-d1a4-4e0d-a3b9-ec51e65aa9e7', 'b0e8d283-d3cc-4874-8806-6acbb550e2b4', '2af11fad-2880-4691-967f-827c16d176eb', '9e44f3e1-dd6a-4345-93c9-0eed3376892b'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-edc342dc-0315-4d8a-8711-dd6debaf9c56 tempest-GroupsV314Test-1493574555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-edc342dc-0315-4d8a-8711-dd6debaf9c56 tempest-GroupsV314Test-1493574555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:22 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-edc342dc-0315-4d8a-8711-dd6debaf9c56 tempest-GroupsV314Test-1493574555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:22 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-edc342dc-0315-4d8a-8711-dd6debaf9c56 tempest-GroupsV314Test-1493574555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-edc342dc-0315-4d8a-8711-dd6debaf9c56 tempest-GroupsV314Test-1493574555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-edc342dc-0315-4d8a-8711-dd6debaf9c56 tempest-GroupsV314Test-1493574555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:22 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:31:22 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:22 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-66b87cd5-853c-4b48-bad9-34d490798209 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.b6bcd962-e338-4c9c-86ee-72bb6b918755" returned: 0 in 0.688s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-66b87cd5-853c-4b48-bad9-34d490798209 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:22 devstack sudo[97941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.info Jul 10 00:31:22 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:22 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-edc342dc-0315-4d8a-8711-dd6debaf9c56 tempest-GroupsV314Test-1493574555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.690s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:22 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-edc342dc-0315-4d8a-8711-dd6debaf9c56 tempest-GroupsV314Test-1493574555 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:31:22 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-edc342dc-0315-4d8a-8711-dd6debaf9c56 tempest-GroupsV314Test-1493574555 None] Delete group completed successfully. Jul 10 00:31:23 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bf891286-a789-4b94-a29b-14c930be3d57 tempest-GroupsV314Test-1493574555 None] Acquiring lock "cinder-quobyte-a5f30a62-8e88-4c57-8efd-6fd0a22f9801" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:23 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bf891286-a789-4b94-a29b-14c930be3d57 tempest-GroupsV314Test-1493574555 None] Lock "cinder-quobyte-a5f30a62-8e88-4c57-8efd-6fd0a22f9801" acquired by "delete_volume" :: waited 0.023s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:23 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6caa1bd8-1042-45bb-b24e-5a5a948ea6e8]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bf891286-a789-4b94-a29b-14c930be3d57 tempest-GroupsV314Test-1493574555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:23 devstack sudo[97944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801 Jul 10 00:31:23 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:23 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-66b87cd5-853c-4b48-bad9-34d490798209 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.info" returned: 0 in 0.717s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:23 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-66b87cd5-853c-4b48-bad9-34d490798209 tempest-GroupSnapshotsTest-103019903 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 00:31:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-66b87cd5-853c-4b48-bad9-34d490798209 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:23 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.info Jul 10 00:31:23 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:23 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-66b87cd5-853c-4b48-bad9-34d490798209 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.info" returned: 0 in 0.653s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:23 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-66b87cd5-853c-4b48-bad9-34d490798209 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.713s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.079s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:23 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1679388199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f3cf55-848d-45ab-93bc-21d43a197aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caf86e45be3d4392b06fe751144235ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:31:10Z,use_quota=True,user_id='96523657f5324cd794cb0c1fa101cb68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:31:23 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Creating volume d9f3cf55-848d-45ab-93bc-21d43a197aab {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:31:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:23 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:23 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:23 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:31:23 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:31:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bf891286-a789-4b94-a29b-14c930be3d57 tempest-GroupsV314Test-1493574555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801" returned: 0 in 0.869s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bf891286-a789-4b94-a29b-14c930be3d57 tempest-GroupsV314Test-1493574555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:24 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab 1073741824 Jul 10 00:31:24 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:24 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801 Jul 10 00:31:24 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:24 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-66b87cd5-853c-4b48-bad9-34d490798209 tempest-GroupSnapshotsTest-103019903 None] group_snapshot 1b7cd7e8-83e2-4c59-bd5e-3cf4f745e77f: created successfully Jul 10 00:31:24 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-46cf98f3-a9cb-428c-bc5c-c55c0924a70f tempest-GroupSnapshotsTest-103019903 None] group_snapshot 1b7cd7e8-83e2-4c59-bd5e-3cf4f745e77f: deleting Jul 10 00:31:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-46cf98f3-a9cb-428c-bc5c-c55c0924a70f tempest-GroupSnapshotsTest-103019903 None] group_snapshot 1b7cd7e8-83e2-4c59-bd5e-3cf4f745e77f: deleting {{(pid=88119) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4351}} Jul 10 00:31:24 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bf891286-a789-4b94-a29b-14c930be3d57 tempest-GroupsV314Test-1493574555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a5f30a62-8e88-4c57-8efd-6fd0a22f9801" returned: 0 in 0.744s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-46cf98f3-a9cb-428c-bc5c-c55c0924a70f tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "cinder-quobyte-59b16cbd-cc9d-4390-801b-5d4c7148fb5c" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bf891286-a789-4b94-a29b-14c930be3d57 tempest-GroupsV314Test-1493574555 None] Lock "cinder-quobyte-a5f30a62-8e88-4c57-8efd-6fd0a22f9801" released by "delete_volume" :: held 1.701s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-46cf98f3-a9cb-428c-bc5c-c55c0924a70f tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-59b16cbd-cc9d-4390-801b-5d4c7148fb5c" acquired by "delete_snapshot" :: waited 0.054s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-46cf98f3-a9cb-428c-bc5c-c55c0924a70f tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "cinder-quobyte-b6bcd962-e338-4c9c-86ee-72bb6b918755" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-46cf98f3-a9cb-428c-bc5c-c55c0924a70f tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-b6bcd962-e338-4c9c-86ee-72bb6b918755" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-46cf98f3-a9cb-428c-bc5c-c55c0924a70f tempest-GroupSnapshotsTest-103019903 None] Deleting offline snapshot b6bcd962-e338-4c9c-86ee-72bb6b918755 of volume 59b16cbd-cc9d-4390-801b-5d4c7148fb5c {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:31:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-46cf98f3-a9cb-428c-bc5c-c55c0924a70f tempest-GroupSnapshotsTest-103019903 None] snapshot_file for this snap is: volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.b6bcd962-e338-4c9c-86ee-72bb6b918755 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:31:24 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d88c6ae-80fe-4880-949d-18c99e2b4625]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-46cf98f3-a9cb-428c-bc5c-c55c0924a70f tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.b6bcd962-e338-4c9c-86ee-72bb6b918755 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:24 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-bf891286-a789-4b94-a29b-14c930be3d57 tempest-GroupsV314Test-1493574555 None] Created reservations ['622bbc0f-1404-4789-88a3-1049c1d147a0'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:24 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab 1073741824" returned: 0 in 1.017s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:25 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.b6bcd962-e338-4c9c-86ee-72bb6b918755 Jul 10 00:31:25 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:25 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-bf891286-a789-4b94-a29b-14c930be3d57 tempest-GroupsV314Test-1493574555 None] Created reservations ['752f2c67-55c1-4bb8-8554-4ce3f8a3f405', '1fc6e74b-cead-446b-9e5e-1197644b8089', '8568ba3d-4985-48ef-a255-a72eddd8aeea', '5c60f41f-74be-4c6d-85be-a6b8db805bcc'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:25 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab Jul 10 00:31:25 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-bf891286-a789-4b94-a29b-14c930be3d57 tempest-GroupsV314Test-1493574555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-bf891286-a789-4b94-a29b-14c930be3d57 tempest-GroupsV314Test-1493574555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:25 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-bf891286-a789-4b94-a29b-14c930be3d57 tempest-GroupsV314Test-1493574555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:25 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-bf891286-a789-4b94-a29b-14c930be3d57 tempest-GroupsV314Test-1493574555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-bf891286-a789-4b94-a29b-14c930be3d57 tempest-GroupsV314Test-1493574555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bf891286-a789-4b94-a29b-14c930be3d57 tempest-GroupsV314Test-1493574555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:25 devstack sudo[97967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:31:25 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:26 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab" returned: 0 in 0.950s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] <== create_volume: return (2071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:31:26 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.075s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-46cf98f3-a9cb-428c-bc5c-c55c0924a70f tempest-GroupSnapshotsTest-103019903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.b6bcd962-e338-4c9c-86ee-72bb6b918755" returned: 0 in 1.165s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-46cf98f3-a9cb-428c-bc5c-c55c0924a70f tempest-GroupSnapshotsTest-103019903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:31:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f590e82-c255-4be9-84ed-fb8b84df2361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9f3cf55-848d-45ab-93bc-21d43a197aab', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1568e8ab-0b6a-4973-92e1-770786ef34e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:26 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf1fe83-bbd3-4d72-998a-5fd44f55d7f8]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-46cf98f3-a9cb-428c-bc5c-c55c0924a70f tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:26 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Volume volume-d9f3cf55-848d-45ab-93bc-21d43a197aab (d9f3cf55-848d-45ab-93bc-21d43a197aab): created successfully Jul 10 00:31:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1568e8ab-0b6a-4973-92e1-770786ef34e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Flow 'volume_create_manager' (904cd255-beeb-4145-b410-0ed6c8aa9faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:31:26 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-4af919e9-c5e4-45f1-94a4-0054bd35fd74 tempest-VolumesDeleteCascade-469997548 None] Created volume successfully. Jul 10 00:31:26 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bf891286-a789-4b94-a29b-14c930be3d57 tempest-GroupsV314Test-1493574555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.041s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:26 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-bf891286-a789-4b94-a29b-14c930be3d57 tempest-GroupsV314Test-1493574555 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:31:26 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-bf891286-a789-4b94-a29b-14c930be3d57 tempest-GroupsV314Test-1493574555 None] Delete group completed successfully. Jul 10 00:31:26 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c Jul 10 00:31:26 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:27 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-46cf98f3-a9cb-428c-bc5c-c55c0924a70f tempest-GroupSnapshotsTest-103019903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c" returned: 0 in 0.994s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-46cf98f3-a9cb-428c-bc5c-c55c0924a70f tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.b6bcd962-e338-4c9c-86ee-72bb6b918755 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:27 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.b6bcd962-e338-4c9c-86ee-72bb6b918755 Jul 10 00:31:27 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-deb77f21-c381-4309-af26-e8789b2df82b tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-deb77f21-c381-4309-af26-e8789b2df82b tempest-VolumesDeleteCascade-469997548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:27 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-deb77f21-c381-4309-af26-e8789b2df82b tempest-VolumesDeleteCascade-469997548 None] Creating offline snapshot 30d22b79-8343-4c92-8a4d-bc0c810f4c2f of volume d9f3cf55-848d-45ab-93bc-21d43a197aab {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:31:27 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f496b0-8893-4d48-ab69-0416fbe22270]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-deb77f21-c381-4309-af26-e8789b2df82b tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:27 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab Jul 10 00:31:27 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:27 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-46cf98f3-a9cb-428c-bc5c-c55c0924a70f tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.b6bcd962-e338-4c9c-86ee-72bb6b918755" returned: 0 in 0.868s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-46cf98f3-a9cb-428c-bc5c-c55c0924a70f tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.b6bcd962-e338-4c9c-86ee-72bb6b918755 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:27 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.b6bcd962-e338-4c9c-86ee-72bb6b918755 Jul 10 00:31:27 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:28 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-deb77f21-c381-4309-af26-e8789b2df82b tempest-VolumesDeleteCascade-469997548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab" returned: 0 in 1.043s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-deb77f21-c381-4309-af26-e8789b2df82b tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.30d22b79-8343-4c92-8a4d-bc0c810f4c2f 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:28 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.30d22b79-8343-4c92-8a4d-bc0c810f4c2f 1G Jul 10 00:31:28 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:28 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-46cf98f3-a9cb-428c-bc5c-c55c0924a70f tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c.b6bcd962-e338-4c9c-86ee-72bb6b918755" returned: 0 in 0.814s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:28 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-46cf98f3-a9cb-428c-bc5c-c55c0924a70f tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-b6bcd962-e338-4c9c-86ee-72bb6b918755" released by "_delete_snapshot" :: held 3.999s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:28 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-46cf98f3-a9cb-428c-bc5c-c55c0924a70f tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-59b16cbd-cc9d-4390-801b-5d4c7148fb5c" released by "delete_snapshot" :: held 4.038s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:28 devstack cinder-volume[88119]: WARNING cinder.quota [None req-46cf98f3-a9cb-428c-bc5c-c55c0924a70f tempest-GroupSnapshotsTest-103019903 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-960631460 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-960631460, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:31:28 devstack cinder-volume[88119]: WARNING cinder.quota [None req-46cf98f3-a9cb-428c-bc5c-c55c0924a70f tempest-GroupSnapshotsTest-103019903 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-960631460 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-960631460, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:31:28 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-46cf98f3-a9cb-428c-bc5c-c55c0924a70f tempest-GroupSnapshotsTest-103019903 None] Created reservations ['e96a9e77-89d9-44d6-8f74-4828193820ce', '6f3158b3-2d36-482d-a991-92b4e09ee6e6', 'c805f0b8-c87b-4010-aa33-ed136e3f122e', 'ff424aeb-0ed6-43c8-8412-f3e8178b1c7d'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:29 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-46cf98f3-a9cb-428c-bc5c-c55c0924a70f tempest-GroupSnapshotsTest-103019903 None] group_snapshot 1b7cd7e8-83e2-4c59-bd5e-3cf4f745e77f: deleted successfully Jul 10 00:31:29 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-63c649a9-0c4b-46a0-a66b-e474796a9800 tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "cinder-quobyte-59b16cbd-cc9d-4390-801b-5d4c7148fb5c" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:29 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-63c649a9-0c4b-46a0-a66b-e474796a9800 tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-59b16cbd-cc9d-4390-801b-5d4c7148fb5c" acquired by "delete_volume" :: waited 0.025s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:29 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bae4fa6-c440-40d4-8ece-626b6340d8e1]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-63c649a9-0c4b-46a0-a66b-e474796a9800 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:29 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c Jul 10 00:31:29 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:29 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-deb77f21-c381-4309-af26-e8789b2df82b tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.30d22b79-8343-4c92-8a4d-bc0c810f4c2f 1G" returned: 0 in 1.171s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-deb77f21-c381-4309-af26-e8789b2df82b tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f3cf55-848d-45ab-93bc-21d43a197aab -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.30d22b79-8343-4c92-8a4d-bc0c810f4c2f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:29 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f3cf55-848d-45ab-93bc-21d43a197aab -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.30d22b79-8343-4c92-8a4d-bc0c810f4c2f Jul 10 00:31:29 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:30 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-63c649a9-0c4b-46a0-a66b-e474796a9800 tempest-GroupSnapshotsTest-103019903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c" returned: 0 in 0.962s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-63c649a9-0c4b-46a0-a66b-e474796a9800 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:30 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c Jul 10 00:31:30 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:30 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-deb77f21-c381-4309-af26-e8789b2df82b tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9f3cf55-848d-45ab-93bc-21d43a197aab -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.30d22b79-8343-4c92-8a4d-bc0c810f4c2f" returned: 0 in 0.959s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:30 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-deb77f21-c381-4309-af26-e8789b2df82b tempest-VolumesDeleteCascade-469997548 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.30d22b79-8343-4c92-8a4d-bc0c810f4c2f is being set with open permissions: ugo+rw Jul 10 00:31:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-deb77f21-c381-4309-af26-e8789b2df82b tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.30d22b79-8343-4c92-8a4d-bc0c810f4c2f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:30 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.30d22b79-8343-4c92-8a4d-bc0c810f4c2f Jul 10 00:31:30 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:31 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-63c649a9-0c4b-46a0-a66b-e474796a9800 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b16cbd-cc9d-4390-801b-5d4c7148fb5c" returned: 0 in 0.797s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-63c649a9-0c4b-46a0-a66b-e474796a9800 tempest-GroupSnapshotsTest-103019903 None] Lock "cinder-quobyte-59b16cbd-cc9d-4390-801b-5d4c7148fb5c" released by "delete_volume" :: held 1.841s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-63c649a9-0c4b-46a0-a66b-e474796a9800 tempest-GroupSnapshotsTest-103019903 None] Created reservations ['dc7f044a-c5c8-4af0-90ca-0d2c687fef9a'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:31 devstack cinder-volume[88119]: WARNING cinder.quota [None req-63c649a9-0c4b-46a0-a66b-e474796a9800 tempest-GroupSnapshotsTest-103019903 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-960631460 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-960631460, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Flow 'volume_create_manager' (bcd1bb43-9458-4a53-b275-595f795f51bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4714fcf8-3f84-4d1b-b0ab-6d8ffe3d7766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-63c649a9-0c4b-46a0-a66b-e474796a9800 tempest-GroupSnapshotsTest-103019903 None] Created reservations ['b56ddf20-fc44-4477-901b-2ce5191b939e', '51296917-9628-4d0a-8907-2bb526724455', '522e7efd-d7ae-4a58-a828-65898a4e4d23', '92b340b9-95bc-49e2-9eb2-eea6d3b93b46'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4714fcf8-3f84-4d1b-b0ab-6d8ffe3d7766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-917101233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18915374c03e4ca79f58b842988ce422',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:31:31Z,use_quota=True,user_id='3d2679b9aac44e889544c02ac3fd244d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8586dc8a-25e3-49f1-a438-b46aa09fc646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8586dc8a-25e3-49f1-a438-b46aa09fc646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe6ac5a6-a5b8-41c3-b43b-f3b2db688806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe6ac5a6-a5b8-41c3-b43b-f3b2db688806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed', 'volume_name': 'volume-7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7692c2-9b5f-45c5-861b-32fafd256963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7692c2-9b5f-45c5-861b-32fafd256963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6466c9da-c965-4f54-a1f9-92169266b3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:31 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Volume 7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed', 'volume_size': 1} Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:31 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-deb77f21-c381-4309-af26-e8789b2df82b tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.30d22b79-8343-4c92-8a4d-bc0c810f4c2f" returned: 0 in 0.917s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:31 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:31:31 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-deb77f21-c381-4309-af26-e8789b2df82b tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:31 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.info Jul 10 00:31:31 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:31 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-4b69e035-d67c-42e0-86ba-4448339dade4 tempest-GroupsV320Test-406225459 None] Group tempest-GroupsV320Test-Group-1745390570: creating Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-63c649a9-0c4b-46a0-a66b-e474796a9800 tempest-GroupSnapshotsTest-103019903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-63c649a9-0c4b-46a0-a66b-e474796a9800 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-63c649a9-0c4b-46a0-a66b-e474796a9800 tempest-GroupSnapshotsTest-103019903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-63c649a9-0c4b-46a0-a66b-e474796a9800 tempest-GroupSnapshotsTest-103019903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-63c649a9-0c4b-46a0-a66b-e474796a9800 tempest-GroupSnapshotsTest-103019903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-63c649a9-0c4b-46a0-a66b-e474796a9800 tempest-GroupSnapshotsTest-103019903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:31 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:31:31 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:31 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-4b69e035-d67c-42e0-86ba-4448339dade4 tempest-GroupsV320Test-406225459 None] Group tempest-GroupsV320Test-Group-1745390570: created successfully Jul 10 00:31:31 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-4b69e035-d67c-42e0-86ba-4448339dade4 tempest-GroupsV320Test-406225459 None] Create group completed successfully. Jul 10 00:31:32 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.905s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:32 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:31:32 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:31:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 9 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:31:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:31:32 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-deb77f21-c381-4309-af26-e8789b2df82b tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.info" returned: 0 in 0.822s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:32 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-deb77f21-c381-4309-af26-e8789b2df82b tempest-VolumesDeleteCascade-469997548 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.info is being set with open permissions: ugo+rw Jul 10 00:31:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-deb77f21-c381-4309-af26-e8789b2df82b tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:32 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.info Jul 10 00:31:32 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:32 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-63c649a9-0c4b-46a0-a66b-e474796a9800 tempest-GroupSnapshotsTest-103019903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.715s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:32 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-63c649a9-0c4b-46a0-a66b-e474796a9800 tempest-GroupSnapshotsTest-103019903 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:31:32 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-63c649a9-0c4b-46a0-a66b-e474796a9800 tempest-GroupSnapshotsTest-103019903 None] Delete group completed successfully. Jul 10 00:31:33 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-deb77f21-c381-4309-af26-e8789b2df82b tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.info" returned: 0 in 0.745s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-deb77f21-c381-4309-af26-e8789b2df82b tempest-VolumesDeleteCascade-469997548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.808s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.746s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-917101233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18915374c03e4ca79f58b842988ce422',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:31:31Z,use_quota=True,user_id='3d2679b9aac44e889544c02ac3fd244d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:31:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Creating volume 7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:31:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:31:33 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:31:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:33 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed 1073741824 Jul 10 00:31:33 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:33 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-deb77f21-c381-4309-af26-e8789b2df82b tempest-VolumesDeleteCascade-469997548 None] Create snapshot completed successfully Jul 10 00:31:33 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-0c0e3b45-150e-4e14-b9e0-036d949badcd tempest-GroupsV320Test-406225459 None] Created reservations ['e639e2ec-8bb4-43ed-9fc9-73d4a5989a25'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0c0e3b45-150e-4e14-b9e0-036d949badcd tempest-GroupsV320Test-406225459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0c0e3b45-150e-4e14-b9e0-036d949badcd tempest-GroupsV320Test-406225459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0c0e3b45-150e-4e14-b9e0-036d949badcd tempest-GroupsV320Test-406225459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0c0e3b45-150e-4e14-b9e0-036d949badcd tempest-GroupsV320Test-406225459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0c0e3b45-150e-4e14-b9e0-036d949badcd tempest-GroupsV320Test-406225459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0c0e3b45-150e-4e14-b9e0-036d949badcd tempest-GroupsV320Test-406225459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:33 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:31:33 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:34 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0c0e3b45-150e-4e14-b9e0-036d949badcd tempest-GroupsV320Test-406225459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.774s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:34 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-0c0e3b45-150e-4e14-b9e0-036d949badcd tempest-GroupsV320Test-406225459 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:31:34 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-0c0e3b45-150e-4e14-b9e0-036d949badcd tempest-GroupsV320Test-406225459 None] Delete group completed successfully. Jul 10 00:31:34 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed 1073741824" returned: 0 in 1.083s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:34 devstack sudo[98076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed Jul 10 00:31:34 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:34 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:31:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Flow 'volume_create_manager' (df72583e-3d34-4c12-802e-a7e1377fa02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:31:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5bb95a-c8f3-4af2-a565-eecfa187c2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5bb95a-c8f3-4af2-a565-eecfa187c2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-907106916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cbbbb82-950c-4fef-bfb0-be1c984ea249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caf86e45be3d4392b06fe751144235ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=30d22b79-8343-4c92-8a4d-bc0c810f4c2f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:31:35Z,use_quota=True,user_id='96523657f5324cd794cb0c1fa101cb68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f771dde9-4ed4-4e12-a9ce-da26727c6d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f771dde9-4ed4-4e12-a9ce-da26727c6d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dedaa8b6-c328-4d50-969e-4596df81f11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dedaa8b6-c328-4d50-969e-4596df81f11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1cbbbb82-950c-4fef-bfb0-be1c984ea249', 'volume_name': 'volume-1cbbbb82-950c-4fef-bfb0-be1c984ea249', 'volume_size': 1, 'snapshot_id': '30d22b79-8343-4c92-8a4d-bc0c810f4c2f'}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb73e48-29da-4f4b-b52c-9cc1f2f7a08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb73e48-29da-4f4b-b52c-9cc1f2f7a08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b44635b-4f32-4524-b5a6-50ce50800c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:34 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Volume 1cbbbb82-950c-4fef-bfb0-be1c984ea249: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1cbbbb82-950c-4fef-bfb0-be1c984ea249', 'volume_size': 1, 'snapshot_id': '30d22b79-8343-4c92-8a4d-bc0c810f4c2f'} Jul 10 00:31:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:35 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed" returned: 0 in 0.805s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] <== create_volume: return (1943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.557s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "cinder-quobyte-30d22b79-8343-4c92-8a4d-bc0c810f4c2f-1cbbbb82-950c-4fef-bfb0-be1c984ea249" by "_create_volume_from_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6466c9da-c965-4f54-a1f9-92169266b3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764d1f4a-5bdc-48c0-a79a-e1a58b4509ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-quobyte-30d22b79-8343-4c92-8a4d-bc0c810f4c2f-1cbbbb82-950c-4fef-bfb0-be1c984ea249" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Creating volume 1cbbbb82-950c-4fef-bfb0-be1c984ea249 from snapshot 30d22b79-8343-4c92-8a4d-bc0c810f4c2f {{(pid=88119) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "cinder-quobyte-1cbbbb82-950c-4fef-bfb0-be1c984ea249" by "_copy_volume_from_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-quobyte-1cbbbb82-950c-4fef-bfb0-be1c984ea249" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] snapshot: 30d22b79-8343-4c92-8a4d-bc0c810f4c2f, volume: 1cbbbb82-950c-4fef-bfb0-be1c984ea249, {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 00:31:35 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Volume volume-7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed (7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed): created successfully Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764d1f4a-5bdc-48c0-a79a-e1a58b4509ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Flow 'volume_create_manager' (bcd1bb43-9458-4a53-b275-595f795f51bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:35 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-e1db4fb6-fe60-472d-893a-e44c0efb74e1 tempest-VolumesServicesTestJSON-2116959139 None] Created volume successfully. Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb57ff4-e554-4759-a723-657154d22d77]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.30d22b79-8343-4c92-8a4d-bc0c810f4c2f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:35 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.30d22b79-8343-4c92-8a4d-bc0c810f4c2f Jul 10 00:31:35 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-98fac292-445d-4563-8147-c776af77c053 tempest-VolumesServicesTestJSON-2116959139 None] Acquiring lock "cinder-7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-98fac292-445d-4563-8147-c776af77c053 tempest-VolumesServicesTestJSON-2116959139 None] Lock "cinder-7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:36 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-98fac292-445d-4563-8147-c776af77c053 tempest-VolumesServicesTestJSON-2116959139 None] Acquiring lock "cinder-quobyte-7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:36 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-98fac292-445d-4563-8147-c776af77c053 tempest-VolumesServicesTestJSON-2116959139 None] Lock "cinder-quobyte-7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed" acquired by "delete_volume" :: waited 0.021s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:36 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7cd80f-faeb-46bf-bd92-f07c7515caef]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-98fac292-445d-4563-8147-c776af77c053 tempest-VolumesServicesTestJSON-2116959139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:36 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed Jul 10 00:31:36 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:36 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.30d22b79-8343-4c92-8a4d-bc0c810f4c2f" returned: 0 in 0.968s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:36 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9f3cf55-848d-45ab-93bc-21d43a197aab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:31:36 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 00:31:36 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Creating direct copy from snapshot {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 00:31:36 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f632ab3f-412c-4df8-90c1-9a46853e701a]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:36 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab Jul 10 00:31:36 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:37 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-98fac292-445d-4563-8147-c776af77c053 tempest-VolumesServicesTestJSON-2116959139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed" returned: 0 in 0.971s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-98fac292-445d-4563-8147-c776af77c053 tempest-VolumesServicesTestJSON-2116959139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:37 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed Jul 10 00:31:37 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:37 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab" returned: 0 in 1.058s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:37 devstack cinder-volume[88119]: DEBUG cinder.utils [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Path /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1cbbbb82-950c-4fef-bfb0-be1c984ea249 not found in is_blk_device check {{(pid=88119) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 00:31:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1cbbbb82-950c-4fef-bfb0-be1c984ea249 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:37 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1cbbbb82-950c-4fef-bfb0-be1c984ea249 Jul 10 00:31:37 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:37 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-98fac292-445d-4563-8147-c776af77c053 tempest-VolumesServicesTestJSON-2116959139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed" returned: 0 in 0.880s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:37 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-98fac292-445d-4563-8147-c776af77c053 tempest-VolumesServicesTestJSON-2116959139 None] Lock "cinder-quobyte-7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed" released by "delete_volume" :: held 1.911s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:38 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-98fac292-445d-4563-8147-c776af77c053 tempest-VolumesServicesTestJSON-2116959139 None] Created reservations ['a3926d8e-47dd-428a-9c74-7472fc400c0f', 'a1384b7a-2036-4a9b-a7b9-4601434e4f15', '1ea4d018-ce7d-4ef6-9820-61f435a2d1bd', '2f746a1b-f9f4-4b19-983b-ad87e555327f'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-98fac292-445d-4563-8147-c776af77c053 tempest-VolumesServicesTestJSON-2116959139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-98fac292-445d-4563-8147-c776af77c053 tempest-VolumesServicesTestJSON-2116959139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:38 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-98fac292-445d-4563-8147-c776af77c053 tempest-VolumesServicesTestJSON-2116959139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:38 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-98fac292-445d-4563-8147-c776af77c053 tempest-VolumesServicesTestJSON-2116959139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-98fac292-445d-4563-8147-c776af77c053 tempest-VolumesServicesTestJSON-2116959139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-98fac292-445d-4563-8147-c776af77c053 tempest-VolumesServicesTestJSON-2116959139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:38 devstack sudo[98103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:31:38 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:39 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-98fac292-445d-4563-8147-c776af77c053 tempest-VolumesServicesTestJSON-2116959139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.477s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:39 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-98fac292-445d-4563-8147-c776af77c053 tempest-VolumesServicesTestJSON-2116959139 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:31:39 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-98fac292-445d-4563-8147-c776af77c053 tempest-VolumesServicesTestJSON-2116959139 None] Deleted volume successfully. Jul 10 00:31:39 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-98fac292-445d-4563-8147-c776af77c053 tempest-VolumesServicesTestJSON-2116959139 None] Lock "cinder-7d0f4dce-85f6-4b3b-83f5-2ee3fb6531ed-delete_volume" released by "delete_volume" :: held 3.673s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:43 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1cbbbb82-950c-4fef-bfb0-be1c984ea249" returned: 0 in 5.974s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:43 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f00a4a-5881-43ac-94b3-2a20086dd2a2]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:43 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab Jul 10 00:31:43 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:44 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab" returned: 0 in 1.096s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:44 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Image conversion details: src /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab, size 1024.00 MB, duration 5.97 sec, destination /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1cbbbb82-950c-4fef-bfb0-be1c984ea249 {{(pid=88119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:31:44 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Converted 1024.00 MB image at 171.38 MB/s Jul 10 00:31:44 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1cbbbb82-950c-4fef-bfb0-be1c984ea249 is being set with open permissions: ugo+rw Jul 10 00:31:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1cbbbb82-950c-4fef-bfb0-be1c984ea249 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:44 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1cbbbb82-950c-4fef-bfb0-be1c984ea249 Jul 10 00:31:44 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:45 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1cbbbb82-950c-4fef-bfb0-be1c984ea249" returned: 0 in 0.660s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-quobyte-1cbbbb82-950c-4fef-bfb0-be1c984ea249" released by "_copy_volume_from_snapshot" :: held 9.898s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-quobyte-30d22b79-8343-4c92-8a4d-bc0c810f4c2f-1cbbbb82-950c-4fef-bfb0-be1c984ea249" released by "_create_volume_from_snapshot" :: held 9.934s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.975s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b44635b-4f32-4524-b5a6-50ce50800c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cbbbb82-950c-4fef-bfb0-be1c984ea249', 'volume_size': 1, 'snapshot_id': '30d22b79-8343-4c92-8a4d-bc0c810f4c2f'}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7725ee58-d9d5-4157-91c8-e5b29dc648b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:45 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Volume volume-1cbbbb82-950c-4fef-bfb0-be1c984ea249 (1cbbbb82-950c-4fef-bfb0-be1c984ea249): created successfully Jul 10 00:31:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7725ee58-d9d5-4157-91c8-e5b29dc648b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Flow 'volume_create_manager' (df72583e-3d34-4c12-802e-a7e1377fa02c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:31:45 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-90aa20ff-76ea-49ef-a45b-9501b52714e6 tempest-VolumesDeleteCascade-469997548 None] Created volume successfully. Jul 10 00:31:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "cinder-d9f3cf55-848d-45ab-93bc-21d43a197aab-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-d9f3cf55-848d-45ab-93bc-21d43a197aab-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Performing cascade delete. {{(pid=88119) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 10 00:31:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "cinder-30d22b79-8343-4c92-8a4d-bc0c810f4c2f-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-30d22b79-8343-4c92-8a4d-bc0c810f4c2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "cinder-quobyte-d9f3cf55-848d-45ab-93bc-21d43a197aab" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-quobyte-d9f3cf55-848d-45ab-93bc-21d43a197aab" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "cinder-quobyte-30d22b79-8343-4c92-8a4d-bc0c810f4c2f" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-quobyte-30d22b79-8343-4c92-8a4d-bc0c810f4c2f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:46 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Deleting offline snapshot 30d22b79-8343-4c92-8a4d-bc0c810f4c2f of volume d9f3cf55-848d-45ab-93bc-21d43a197aab {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:31:46 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] snapshot_file for this snap is: volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.30d22b79-8343-4c92-8a4d-bc0c810f4c2f {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:31:46 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea959e5-3c0f-4915-883f-01b5c6a8f0a4]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.30d22b79-8343-4c92-8a4d-bc0c810f4c2f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:46 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.30d22b79-8343-4c92-8a4d-bc0c810f4c2f Jul 10 00:31:46 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:47 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.30d22b79-8343-4c92-8a4d-bc0c810f4c2f" returned: 0 in 0.914s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9f3cf55-848d-45ab-93bc-21d43a197aab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:31:47 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[49583319-7792-42f1-8c9c-e6b12385c54f]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:47 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab Jul 10 00:31:47 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:48 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-cfd0e8f8-8139-403a-8631-1c0661be2e83 tempest-GroupsTest-1554229273 None] Group tempest-Group1-2141139266: creating Jul 10 00:31:48 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-cfd0e8f8-8139-403a-8631-1c0661be2e83 tempest-GroupsTest-1554229273 None] Group tempest-Group1-2141139266: created successfully Jul 10 00:31:48 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-cfd0e8f8-8139-403a-8631-1c0661be2e83 tempest-GroupsTest-1554229273 None] Create group completed successfully. Jul 10 00:31:48 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab" returned: 0 in 0.989s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.30d22b79-8343-4c92-8a4d-bc0c810f4c2f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:48 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.30d22b79-8343-4c92-8a4d-bc0c810f4c2f Jul 10 00:31:48 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:48 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:31:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Flow 'volume_create_manager' (36558c52-e6ca-4893-89eb-a46252204cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:31:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67c0c906-07cd-41bd-a637-8d0c89384d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67c0c906-07cd-41bd-a637-8d0c89384d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-109523715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f547e0f7-2f44-4b1c-9203-eae304ae6d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='041698f86b994efea55c01ad685b9119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:31:49Z,use_quota=True,user_id='331a16c09e1c451a9e0b07b282bb9170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24bfb905-216c-48ae-882a-6b05f2c719e7),volume_type_id=24bfb905-216c-48ae-882a-6b05f2c719e7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d062ade-3ce2-421b-a81e-a4bac37efb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d062ade-3ce2-421b-a81e-a4bac37efb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (705f80ab-2670-4f79-83da-3da6a16b463f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (705f80ab-2670-4f79-83da-3da6a16b463f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f547e0f7-2f44-4b1c-9203-eae304ae6d64', 'volume_name': 'volume-f547e0f7-2f44-4b1c-9203-eae304ae6d64', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11be473f-f971-4cc3-b1ab-37868be187b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11be473f-f971-4cc3-b1ab-37868be187b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826ef23d-8b27-44ac-9f57-d36009242efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:48 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Volume f547e0f7-2f44-4b1c-9203-eae304ae6d64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f547e0f7-2f44-4b1c-9203-eae304ae6d64', 'volume_size': 1} Jul 10 00:31:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-109523715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f547e0f7-2f44-4b1c-9203-eae304ae6d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='041698f86b994efea55c01ad685b9119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:31:49Z,use_quota=True,user_id='331a16c09e1c451a9e0b07b282bb9170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24bfb905-216c-48ae-882a-6b05f2c719e7),volume_type_id=24bfb905-216c-48ae-882a-6b05f2c719e7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:31:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Creating volume f547e0f7-2f44-4b1c-9203-eae304ae6d64 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:31:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:31:48 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:31:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f547e0f7-2f44-4b1c-9203-eae304ae6d64 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:48 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f547e0f7-2f44-4b1c-9203-eae304ae6d64 1073741824 Jul 10 00:31:48 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:49 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.30d22b79-8343-4c92-8a4d-bc0c810f4c2f" returned: 0 in 0.855s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.30d22b79-8343-4c92-8a4d-bc0c810f4c2f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:49 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.30d22b79-8343-4c92-8a4d-bc0c810f4c2f Jul 10 00:31:49 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:49 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-7f1c7f20-a8a8-49b7-9200-83222610b244 tempest-GroupsTest-1554229273 None] Group tempest-Group2-1231717355: creating Jul 10 00:31:49 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-7f1c7f20-a8a8-49b7-9200-83222610b244 tempest-GroupsTest-1554229273 None] Group tempest-Group2-1231717355: created successfully Jul 10 00:31:49 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-7f1c7f20-a8a8-49b7-9200-83222610b244 tempest-GroupsTest-1554229273 None] Create group completed successfully. Jul 10 00:31:49 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab.30d22b79-8343-4c92-8a4d-bc0c810f4c2f" returned: 0 in 0.776s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-quobyte-30d22b79-8343-4c92-8a4d-bc0c810f4c2f" released by "_delete_snapshot" :: held 3.683s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-quobyte-d9f3cf55-848d-45ab-93bc-21d43a197aab" released by "delete_snapshot" :: held 3.719s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:49 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Created reservations ['374caa17-27c1-4917-aef1-1c9b92695391', '25704fe1-4fab-40ef-b4ce-8610d82320e4', '03a230db-5fe9-4fda-b141-ae1ac8adedc0', '991db54e-5ead-4a3e-ae42-7c19ff96c8f1'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:49 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f547e0f7-2f44-4b1c-9203-eae304ae6d64 1073741824" returned: 0 in 1.014s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f547e0f7-2f44-4b1c-9203-eae304ae6d64 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:50 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Delete snapshot completed successfully. Jul 10 00:31:50 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-30d22b79-8343-4c92-8a4d-bc0c810f4c2f-delete_snapshot" released by "delete_snapshot" :: held 3.889s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Snapshots deleted, issuing volume delete {{(pid=88119) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 10 00:31:50 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "cinder-quobyte-d9f3cf55-848d-45ab-93bc-21d43a197aab" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:50 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f547e0f7-2f44-4b1c-9203-eae304ae6d64 Jul 10 00:31:50 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:50 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-quobyte-d9f3cf55-848d-45ab-93bc-21d43a197aab" acquired by "delete_volume" :: waited 0.017s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:50 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f38768a-7ba2-4304-ad09-58118e6ace57]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:50 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab Jul 10 00:31:50 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:50 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f547e0f7-2f44-4b1c-9203-eae304ae6d64" returned: 0 in 0.754s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:31:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826ef23d-8b27-44ac-9f57-d36009242efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f547e0f7-2f44-4b1c-9203-eae304ae6d64', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84bbdf57-2f44-4834-95d7-c28eee5776d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:50 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Volume volume-f547e0f7-2f44-4b1c-9203-eae304ae6d64 (f547e0f7-2f44-4b1c-9203-eae304ae6d64): created successfully Jul 10 00:31:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84bbdf57-2f44-4834-95d7-c28eee5776d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Flow 'volume_create_manager' (36558c52-e6ca-4893-89eb-a46252204cf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:31:50 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-27ecd956-fb3b-4ce2-82b7-3317d3c8d19c tempest-VolumeTypesAccessTest-1668984963 None] Created volume successfully. Jul 10 00:31:50 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab" returned: 0 in 0.892s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:51 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab Jul 10 00:31:51 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Flow 'volume_create_manager' (241b26a5-396c-4a4b-9492-79e152239c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb6d728-18aa-4700-844b-6898ad528130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb6d728-18aa-4700-844b-6898ad528130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-166545166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f15a5ec5-332a-4640-8c17-e5f5d524a5d0,host='devstack@QuobyteHD#QuobyteHD',id=34681e89-da51-4a09-8853-cc808a685077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bb50d23c7f248e99990884750f504cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:31:51Z,use_quota=True,user_id='85d1c2d3ca5642ce927abc6acd6bf672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32c9e5fe-c80f-4b06-8f6c-ed0ada01ac95),volume_type_id=32c9e5fe-c80f-4b06-8f6c-ed0ada01ac95)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84af41a7-1bc4-47ee-bb7c-0fab088d3f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84af41a7-1bc4-47ee-bb7c-0fab088d3f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b1d3a4-06d5-4227-a96d-ff1622d2f10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b1d3a4-06d5-4227-a96d-ff1622d2f10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34681e89-da51-4a09-8853-cc808a685077', 'volume_name': 'volume-34681e89-da51-4a09-8853-cc808a685077', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09b55972-d200-4418-86a2-6ac070363496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09b55972-d200-4418-86a2-6ac070363496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c020c6c6-039b-4969-9371-39dccb5ab3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:51 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Volume 34681e89-da51-4a09-8853-cc808a685077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34681e89-da51-4a09-8853-cc808a685077', 'volume_size': 1} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f15a5ec5-332a-4640-8c17-e5f5d524a5d0,created_at=2026-07-09T22:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-166545166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f15a5ec5-332a-4640-8c17-e5f5d524a5d0,host='devstack@QuobyteHD#QuobyteHD',id=34681e89-da51-4a09-8853-cc808a685077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bb50d23c7f248e99990884750f504cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:31:51Z,use_quota=True,user_id='85d1c2d3ca5642ce927abc6acd6bf672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32c9e5fe-c80f-4b06-8f6c-ed0ada01ac95),volume_type_id=32c9e5fe-c80f-4b06-8f6c-ed0ada01ac95)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Creating volume 34681e89-da51-4a09-8853-cc808a685077 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:31:51 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34681e89-da51-4a09-8853-cc808a685077 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:51 devstack sudo[98169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34681e89-da51-4a09-8853-cc808a685077 1073741824 Jul 10 00:31:51 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:51 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d9f3cf55-848d-45ab-93bc-21d43a197aab" returned: 0 in 0.695s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-quobyte-d9f3cf55-848d-45ab-93bc-21d43a197aab" released by "delete_volume" :: held 1.671s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Created reservations ['a936ab78-28f3-42cd-9caf-a5bfdbf65aa3', '75738b9a-4832-4504-9762-fa108a5ece86', '287d7932-fde7-47a1-a9ab-20aa1bf37521', 'ed4e250d-6966-4043-8b78-664625bd7ed6'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:51 devstack sudo[98172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:31:51 devstack sudo[98172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8a215030-b5e8-4ee7-bd38-a7ab90280bf8 tempest-VolumeTypesAccessTest-1668984963 None] Acquiring lock "cinder-f547e0f7-2f44-4b1c-9203-eae304ae6d64-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Flow 'volume_create_manager' (7c68cb2c-387d-47e4-b3ac-f50e6b43a7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e1f47fa-d26a-4529-8070-38fb8e493118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e1f47fa-d26a-4529-8070-38fb8e493118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-81738866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f89eb15-4370-4ae7-996d-645b66771ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35e05c3a47ed461381153d2476f9ed43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:31:52Z,use_quota=True,user_id='ca8d5a5542eb461bb32ed407c95d0643',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0dd9379e-df5d-4585-9421-1e2aece5c509),volume_type_id=0dd9379e-df5d-4585-9421-1e2aece5c509)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d1ca71-0721-4899-a16f-e9c680cd79fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d1ca71-0721-4899-a16f-e9c680cd79fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (916c0b09-5723-4090-bd3e-1ee7a87346a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (916c0b09-5723-4090-bd3e-1ee7a87346a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f89eb15-4370-4ae7-996d-645b66771ac6', 'volume_name': 'volume-8f89eb15-4370-4ae7-996d-645b66771ac6', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca3a2f7a-22f4-4207-936f-01328d359c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca3a2f7a-22f4-4207-936f-01328d359c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd23f25-ef34-46a2-978e-913202d362f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:52 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Volume 8f89eb15-4370-4ae7-996d-645b66771ac6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f89eb15-4370-4ae7-996d-645b66771ac6', 'volume_size': 1} Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8a215030-b5e8-4ee7-bd38-a7ab90280bf8 tempest-VolumeTypesAccessTest-1668984963 None] Lock "cinder-f547e0f7-2f44-4b1c-9203-eae304ae6d64-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8a215030-b5e8-4ee7-bd38-a7ab90280bf8 tempest-VolumeTypesAccessTest-1668984963 None] Acquiring lock "cinder-quobyte-f547e0f7-2f44-4b1c-9203-eae304ae6d64" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:52 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8a215030-b5e8-4ee7-bd38-a7ab90280bf8 tempest-VolumeTypesAccessTest-1668984963 None] Lock "cinder-quobyte-f547e0f7-2f44-4b1c-9203-eae304ae6d64" acquired by "delete_volume" :: waited 0.017s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34681e89-da51-4a09-8853-cc808a685077 1073741824" returned: 0 in 1.025s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[207e1114-5779-453f-84d3-3c23d5cf872c]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8a215030-b5e8-4ee7-bd38-a7ab90280bf8 tempest-VolumeTypesAccessTest-1668984963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f547e0f7-2f44-4b1c-9203-eae304ae6d64 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34681e89-da51-4a09-8853-cc808a685077 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:52 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34681e89-da51-4a09-8853-cc808a685077 Jul 10 00:31:52 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:52 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f547e0f7-2f44-4b1c-9203-eae304ae6d64 Jul 10 00:31:52 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:52 devstack sudo[98172]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.767s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:31:52 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Deleted volume successfully. Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7d38f567-ed5f-4677-abc9-04688a8b020c tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-d9f3cf55-848d-45ab-93bc-21d43a197aab-delete_volume" released by "delete_volume" :: held 6.641s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-22a1bb79-af56-4bca-a551-6cd25ef89696 tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "cinder-1cbbbb82-950c-4fef-bfb0-be1c984ea249-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-22a1bb79-af56-4bca-a551-6cd25ef89696 tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-1cbbbb82-950c-4fef-bfb0-be1c984ea249-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-22a1bb79-af56-4bca-a551-6cd25ef89696 tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "cinder-quobyte-1cbbbb82-950c-4fef-bfb0-be1c984ea249" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-22a1bb79-af56-4bca-a551-6cd25ef89696 tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-quobyte-1cbbbb82-950c-4fef-bfb0-be1c984ea249" acquired by "delete_volume" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:53 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1673131a-0cb0-46a4-b8a7-0d4ec3263c2a]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22a1bb79-af56-4bca-a551-6cd25ef89696 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1cbbbb82-950c-4fef-bfb0-be1c984ea249 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:53 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34681e89-da51-4a09-8853-cc808a685077" returned: 0 in 0.740s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:31:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.865s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-81738866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f89eb15-4370-4ae7-996d-645b66771ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35e05c3a47ed461381153d2476f9ed43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:31:52Z,use_quota=True,user_id='ca8d5a5542eb461bb32ed407c95d0643',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0dd9379e-df5d-4585-9421-1e2aece5c509),volume_type_id=0dd9379e-df5d-4585-9421-1e2aece5c509)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:31:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Creating volume 8f89eb15-4370-4ae7-996d-645b66771ac6 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:31:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:31:53 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:31:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f89eb15-4370-4ae7-996d-645b66771ac6 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:53 devstack sudo[98184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1cbbbb82-950c-4fef-bfb0-be1c984ea249 Jul 10 00:31:53 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:53 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f89eb15-4370-4ae7-996d-645b66771ac6 1073741824 Jul 10 00:31:53 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c020c6c6-039b-4969-9371-39dccb5ab3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34681e89-da51-4a09-8853-cc808a685077', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd325325-ccda-4f04-aa98-244fad444d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:53 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Volume volume-34681e89-da51-4a09-8853-cc808a685077 (34681e89-da51-4a09-8853-cc808a685077): created successfully Jul 10 00:31:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd325325-ccda-4f04-aa98-244fad444d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Flow 'volume_create_manager' (241b26a5-396c-4a4b-9492-79e152239c21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:31:53 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-33ba0a22-3bda-49be-ac9a-c595917ceaf5 tempest-GroupsTest-1554229273 None] Created volume successfully. Jul 10 00:31:53 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8a215030-b5e8-4ee7-bd38-a7ab90280bf8 tempest-VolumeTypesAccessTest-1668984963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f547e0f7-2f44-4b1c-9203-eae304ae6d64" returned: 0 in 0.903s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8a215030-b5e8-4ee7-bd38-a7ab90280bf8 tempest-VolumeTypesAccessTest-1668984963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f547e0f7-2f44-4b1c-9203-eae304ae6d64 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:53 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f547e0f7-2f44-4b1c-9203-eae304ae6d64 Jul 10 00:31:53 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:53 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22a1bb79-af56-4bca-a551-6cd25ef89696 tempest-VolumesDeleteCascade-469997548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1cbbbb82-950c-4fef-bfb0-be1c984ea249" returned: 0 in 0.907s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22a1bb79-af56-4bca-a551-6cd25ef89696 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1cbbbb82-950c-4fef-bfb0-be1c984ea249 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:53 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8a215030-b5e8-4ee7-bd38-a7ab90280bf8 tempest-VolumeTypesAccessTest-1668984963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f547e0f7-2f44-4b1c-9203-eae304ae6d64" returned: 0 in 0.714s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:53 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1cbbbb82-950c-4fef-bfb0-be1c984ea249 Jul 10 00:31:53 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8a215030-b5e8-4ee7-bd38-a7ab90280bf8 tempest-VolumeTypesAccessTest-1668984963 None] Lock "cinder-quobyte-f547e0f7-2f44-4b1c-9203-eae304ae6d64" released by "delete_volume" :: held 1.679s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:54 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f89eb15-4370-4ae7-996d-645b66771ac6 1073741824" returned: 0 in 0.894s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:54 devstack cinder-volume[88119]: WARNING cinder.quota [None req-8a215030-b5e8-4ee7-bd38-a7ab90280bf8 tempest-VolumeTypesAccessTest-1668984963 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-462179159 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-462179159, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:31:54 devstack cinder-volume[88119]: WARNING cinder.quota [None req-8a215030-b5e8-4ee7-bd38-a7ab90280bf8 tempest-VolumeTypesAccessTest-1668984963 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-462179159 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-462179159, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:31:54 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-8a215030-b5e8-4ee7-bd38-a7ab90280bf8 tempest-VolumeTypesAccessTest-1668984963 None] Created reservations ['2932b5fa-6c6b-4c70-8782-944635cca29d', '79b26174-fa45-4fd5-b213-00fdeef3684b', '7f82a050-244c-4cad-b15c-4cd03e40f8c6', '562e7853-ebf1-46a9-bbfb-0bebfa0e05b6'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f89eb15-4370-4ae7-996d-645b66771ac6 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:54 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f89eb15-4370-4ae7-996d-645b66771ac6 Jul 10 00:31:54 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8a215030-b5e8-4ee7-bd38-a7ab90280bf8 tempest-VolumeTypesAccessTest-1668984963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8a215030-b5e8-4ee7-bd38-a7ab90280bf8 tempest-VolumeTypesAccessTest-1668984963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8a215030-b5e8-4ee7-bd38-a7ab90280bf8 tempest-VolumeTypesAccessTest-1668984963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8a215030-b5e8-4ee7-bd38-a7ab90280bf8 tempest-VolumeTypesAccessTest-1668984963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8a215030-b5e8-4ee7-bd38-a7ab90280bf8 tempest-VolumeTypesAccessTest-1668984963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8a215030-b5e8-4ee7-bd38-a7ab90280bf8 tempest-VolumeTypesAccessTest-1668984963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:54 devstack sudo[98206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:31:54 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-dba71e63-a745-4761-88fb-b69f7933d9ec tempest-GroupsTest-1554229273 None] Acquiring lock "cinder-quobyte-34681e89-da51-4a09-8853-cc808a685077" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-dba71e63-a745-4761-88fb-b69f7933d9ec tempest-GroupsTest-1554229273 None] Lock "cinder-quobyte-34681e89-da51-4a09-8853-cc808a685077" acquired by "delete_volume" :: waited 0.029s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:54 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5ba13c-ed9d-42c5-a9db-ac68f3d4973b]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dba71e63-a745-4761-88fb-b69f7933d9ec tempest-GroupsTest-1554229273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34681e89-da51-4a09-8853-cc808a685077 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:54 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34681e89-da51-4a09-8853-cc808a685077 Jul 10 00:31:54 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:54 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f89eb15-4370-4ae7-996d-645b66771ac6" returned: 0 in 0.855s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:31:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:54 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22a1bb79-af56-4bca-a551-6cd25ef89696 tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1cbbbb82-950c-4fef-bfb0-be1c984ea249" returned: 0 in 1.030s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-22a1bb79-af56-4bca-a551-6cd25ef89696 tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-quobyte-1cbbbb82-950c-4fef-bfb0-be1c984ea249" released by "delete_volume" :: held 2.011s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd23f25-ef34-46a2-978e-913202d362f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f89eb15-4370-4ae7-996d-645b66771ac6', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba34d462-1fef-4973-a5dc-0793db29495e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:31:55 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Volume volume-8f89eb15-4370-4ae7-996d-645b66771ac6 (8f89eb15-4370-4ae7-996d-645b66771ac6): created successfully Jul 10 00:31:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba34d462-1fef-4973-a5dc-0793db29495e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:31:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Flow 'volume_create_manager' (7c68cb2c-387d-47e4-b3ac-f50e6b43a7d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:31:55 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-1452d25d-8db2-412b-a6a2-ad857b889f87 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Created volume successfully. Jul 10 00:31:55 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-22a1bb79-af56-4bca-a551-6cd25ef89696 tempest-VolumesDeleteCascade-469997548 None] Created reservations ['5559d5e3-790a-486f-9e99-98b1312d452e', '0309010c-30a6-44f0-8134-88147c3def8d', '7fb15cec-cf21-4eaa-b6c9-fe8c20218698', '3c353b98-9d8c-455b-be73-ebd7ffa2e7ac'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-22a1bb79-af56-4bca-a551-6cd25ef89696 tempest-VolumesDeleteCascade-469997548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-22a1bb79-af56-4bca-a551-6cd25ef89696 tempest-VolumesDeleteCascade-469997548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:55 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-22a1bb79-af56-4bca-a551-6cd25ef89696 tempest-VolumesDeleteCascade-469997548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:55 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-22a1bb79-af56-4bca-a551-6cd25ef89696 tempest-VolumesDeleteCascade-469997548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-22a1bb79-af56-4bca-a551-6cd25ef89696 tempest-VolumesDeleteCascade-469997548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22a1bb79-af56-4bca-a551-6cd25ef89696 tempest-VolumesDeleteCascade-469997548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:55 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8a215030-b5e8-4ee7-bd38-a7ab90280bf8 tempest-VolumeTypesAccessTest-1668984963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.035s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:55 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-8a215030-b5e8-4ee7-bd38-a7ab90280bf8 tempest-VolumeTypesAccessTest-1668984963 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:31:55 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-8a215030-b5e8-4ee7-bd38-a7ab90280bf8 tempest-VolumeTypesAccessTest-1668984963 None] Deleted volume successfully. Jul 10 00:31:55 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:31:55 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:55 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8a215030-b5e8-4ee7-bd38-a7ab90280bf8 tempest-VolumeTypesAccessTest-1668984963 None] Lock "cinder-f547e0f7-2f44-4b1c-9203-eae304ae6d64-delete_volume" released by "delete_volume" :: held 2.966s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:55 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dba71e63-a745-4761-88fb-b69f7933d9ec tempest-GroupsTest-1554229273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34681e89-da51-4a09-8853-cc808a685077" returned: 0 in 0.988s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dba71e63-a745-4761-88fb-b69f7933d9ec tempest-GroupsTest-1554229273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34681e89-da51-4a09-8853-cc808a685077 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:55 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34681e89-da51-4a09-8853-cc808a685077 Jul 10 00:31:55 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a92a3b1f-097b-4999-8040-976e406d7391 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a92a3b1f-097b-4999-8040-976e406d7391 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:55 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a92a3b1f-097b-4999-8040-976e406d7391 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:55 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a92a3b1f-097b-4999-8040-976e406d7391 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a92a3b1f-097b-4999-8040-976e406d7391 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a92a3b1f-097b-4999-8040-976e406d7391 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:55 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:31:55 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:56 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22a1bb79-af56-4bca-a551-6cd25ef89696 tempest-VolumesDeleteCascade-469997548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.954s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:56 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-22a1bb79-af56-4bca-a551-6cd25ef89696 tempest-VolumesDeleteCascade-469997548 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:31:56 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-22a1bb79-af56-4bca-a551-6cd25ef89696 tempest-VolumesDeleteCascade-469997548 None] Deleted volume successfully. Jul 10 00:31:56 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-22a1bb79-af56-4bca-a551-6cd25ef89696 tempest-VolumesDeleteCascade-469997548 None] Lock "cinder-1cbbbb82-950c-4fef-bfb0-be1c984ea249-delete_volume" released by "delete_volume" :: held 3.292s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:56 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dba71e63-a745-4761-88fb-b69f7933d9ec tempest-GroupsTest-1554229273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34681e89-da51-4a09-8853-cc808a685077" returned: 0 in 0.913s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:56 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-dba71e63-a745-4761-88fb-b69f7933d9ec tempest-GroupsTest-1554229273 None] Lock "cinder-quobyte-34681e89-da51-4a09-8853-cc808a685077" released by "delete_volume" :: held 1.965s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:56 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-dba71e63-a745-4761-88fb-b69f7933d9ec tempest-GroupsTest-1554229273 None] Created reservations ['e642eda4-d89f-40a3-9ed6-a5a2aeac4a9f'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:56 devstack cinder-volume[88119]: WARNING cinder.quota [None req-dba71e63-a745-4761-88fb-b69f7933d9ec tempest-GroupsTest-1554229273 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2055552302 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2055552302, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:31:56 devstack cinder-volume[88119]: WARNING cinder.quota [None req-dba71e63-a745-4761-88fb-b69f7933d9ec tempest-GroupsTest-1554229273 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2055552302 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2055552302, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:31:56 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-dba71e63-a745-4761-88fb-b69f7933d9ec tempest-GroupsTest-1554229273 None] Created reservations ['dfabc60b-99ca-436f-afb1-faa41d9877dd', '6b0e602f-8394-4d71-9c41-45e634957143', '083ed54d-93ac-48c7-af13-e036f9e7be31', 'caf0af36-52b6-4645-ad2f-b231730c527c'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dba71e63-a745-4761-88fb-b69f7933d9ec tempest-GroupsTest-1554229273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dba71e63-a745-4761-88fb-b69f7933d9ec tempest-GroupsTest-1554229273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-dba71e63-a745-4761-88fb-b69f7933d9ec tempest-GroupsTest-1554229273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-dba71e63-a745-4761-88fb-b69f7933d9ec tempest-GroupsTest-1554229273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dba71e63-a745-4761-88fb-b69f7933d9ec tempest-GroupsTest-1554229273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dba71e63-a745-4761-88fb-b69f7933d9ec tempest-GroupsTest-1554229273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:56 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:31:56 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:56 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a92a3b1f-097b-4999-8040-976e406d7391 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.839s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:56 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-a92a3b1f-097b-4999-8040-976e406d7391 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:31:56 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-a92a3b1f-097b-4999-8040-976e406d7391 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Retype volume completed successfully. Jul 10 00:31:56 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-e0fdf36f-294f-4d86-a10b-a1f0fdd9a36f tempest-GroupsTest-1554229273 None] Created reservations ['44dede01-fd7b-423a-9deb-6d07c55f67d7'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e0fdf36f-294f-4d86-a10b-a1f0fdd9a36f tempest-GroupsTest-1554229273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e0fdf36f-294f-4d86-a10b-a1f0fdd9a36f tempest-GroupsTest-1554229273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:57 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e0fdf36f-294f-4d86-a10b-a1f0fdd9a36f tempest-GroupsTest-1554229273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:57 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e0fdf36f-294f-4d86-a10b-a1f0fdd9a36f tempest-GroupsTest-1554229273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e0fdf36f-294f-4d86-a10b-a1f0fdd9a36f tempest-GroupsTest-1554229273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e0fdf36f-294f-4d86-a10b-a1f0fdd9a36f tempest-GroupsTest-1554229273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:57 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:31:57 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:57 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3d51d596-84c4-4828-a87f-747fb7922d09 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Acquiring lock "cinder-8f89eb15-4370-4ae7-996d-645b66771ac6-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:57 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3d51d596-84c4-4828-a87f-747fb7922d09 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Lock "cinder-8f89eb15-4370-4ae7-996d-645b66771ac6-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:57 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3d51d596-84c4-4828-a87f-747fb7922d09 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Acquiring lock "cinder-quobyte-8f89eb15-4370-4ae7-996d-645b66771ac6" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:31:57 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3d51d596-84c4-4828-a87f-747fb7922d09 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Lock "cinder-quobyte-8f89eb15-4370-4ae7-996d-645b66771ac6" acquired by "delete_volume" :: waited 0.040s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:31:57 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dba71e63-a745-4761-88fb-b69f7933d9ec tempest-GroupsTest-1554229273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.932s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:57 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-dba71e63-a745-4761-88fb-b69f7933d9ec tempest-GroupsTest-1554229273 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:31:57 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7d14ff-72d1-4890-8b99-7efecb2ae794]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:31:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3d51d596-84c4-4828-a87f-747fb7922d09 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f89eb15-4370-4ae7-996d-645b66771ac6 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:57 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-dba71e63-a745-4761-88fb-b69f7933d9ec tempest-GroupsTest-1554229273 None] Delete group completed successfully. Jul 10 00:31:57 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f89eb15-4370-4ae7-996d-645b66771ac6 Jul 10 00:31:57 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:58 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e0fdf36f-294f-4d86-a10b-a1f0fdd9a36f tempest-GroupsTest-1554229273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.088s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:58 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-e0fdf36f-294f-4d86-a10b-a1f0fdd9a36f tempest-GroupsTest-1554229273 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:31:58 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-e0fdf36f-294f-4d86-a10b-a1f0fdd9a36f tempest-GroupsTest-1554229273 None] Delete group completed successfully. Jul 10 00:31:58 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3d51d596-84c4-4828-a87f-747fb7922d09 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f89eb15-4370-4ae7-996d-645b66771ac6" returned: 0 in 0.970s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3d51d596-84c4-4828-a87f-747fb7922d09 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f89eb15-4370-4ae7-996d-645b66771ac6 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:58 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f89eb15-4370-4ae7-996d-645b66771ac6 Jul 10 00:31:58 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:31:58 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-bac77046-0d50-48c5-88b9-35ff37eeb5a8 tempest-GroupsTest-1554229273 None] Group tempest-GroupsTest-Group-887392791: creating Jul 10 00:31:58 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-bac77046-0d50-48c5-88b9-35ff37eeb5a8 tempest-GroupsTest-1554229273 None] Group tempest-GroupsTest-Group-887392791: created successfully Jul 10 00:31:58 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-bac77046-0d50-48c5-88b9-35ff37eeb5a8 tempest-GroupsTest-1554229273 None] Create group completed successfully. Jul 10 00:31:59 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Jul 10 00:31:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3d51d596-84c4-4828-a87f-747fb7922d09 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f89eb15-4370-4ae7-996d-645b66771ac6" returned: 0 in 0.803s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:31:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3d51d596-84c4-4828-a87f-747fb7922d09 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Lock "cinder-quobyte-8f89eb15-4370-4ae7-996d-645b66771ac6" released by "delete_volume" :: held 1.856s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:31:59 devstack cinder-volume[88119]: WARNING cinder.quota [None req-3d51d596-84c4-4828-a87f-747fb7922d09 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:31:59 devstack cinder-volume[88119]: WARNING cinder.quota [None req-3d51d596-84c4-4828-a87f-747fb7922d09 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:31:59 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-3d51d596-84c4-4828-a87f-747fb7922d09 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Created reservations ['6786ca68-0b72-4c13-a9a6-08a68e6bf2f2', 'dbe9dd87-465b-4217-a444-d76e5bc72eba', '820056ce-3ca6-4084-98c2-2f6468e59c0a', '0e4527a8-6398-4527-86f1-1ebbd40014c9'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:31:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3d51d596-84c4-4828-a87f-747fb7922d09 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:31:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3d51d596-84c4-4828-a87f-747fb7922d09 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:31:59 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-3d51d596-84c4-4828-a87f-747fb7922d09 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:31:59 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-3d51d596-84c4-4828-a87f-747fb7922d09 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:31:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3d51d596-84c4-4828-a87f-747fb7922d09 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:31:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3d51d596-84c4-4828-a87f-747fb7922d09 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:31:59 devstack sudo[98241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:31:59 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:00 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3d51d596-84c4-4828-a87f-747fb7922d09 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.110s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:00 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-3d51d596-84c4-4828-a87f-747fb7922d09 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:32:00 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-3d51d596-84c4-4828-a87f-747fb7922d09 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Deleted volume successfully. Jul 10 00:32:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3d51d596-84c4-4828-a87f-747fb7922d09 tempest-VolumeRetypeWithoutMigrationTest-31560618 None] Lock "cinder-8f89eb15-4370-4ae7-996d-645b66771ac6-delete_volume" released by "delete_volume" :: held 3.320s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:00 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:32:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Flow 'volume_create_manager' (045efc53-476a-4cb4-a21d-feac4f8d30e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab48b11d-eaec-4805-b730-49bce10f3281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:01 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab48b11d-eaec-4805-b730-49bce10f3281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-180006257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=97f5e829-c7d2-45d9-8a7d-75bd07bfe929,host='devstack@QuobyteHD#QuobyteHD',id=2e5b7078-ef09-4688-803c-8cd23eb3d50c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bb50d23c7f248e99990884750f504cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:01Z,use_quota=True,user_id='85d1c2d3ca5642ce927abc6acd6bf672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f69854-7f01-490d-987a-2fe517fa578f),volume_type_id=01f69854-7f01-490d-987a-2fe517fa578f)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:01 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7683ffe-5a40-48a1-845d-7ea28940d36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:01 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7683ffe-5a40-48a1-845d-7ea28940d36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:01 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736f0c12-882e-48db-b605-e76712e8f630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:01 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (736f0c12-882e-48db-b605-e76712e8f630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e5b7078-ef09-4688-803c-8cd23eb3d50c', 'volume_name': 'volume-2e5b7078-ef09-4688-803c-8cd23eb3d50c', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:01 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e8ac3a4-e8de-4dd3-b04d-d5555705fa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:01 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e8ac3a4-e8de-4dd3-b04d-d5555705fa49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:01 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7928d46a-e0ca-46df-9676-f37ba30a52fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:01 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Volume 2e5b7078-ef09-4688-803c-8cd23eb3d50c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e5b7078-ef09-4688-803c-8cd23eb3d50c', 'volume_size': 1} Jul 10 00:32:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:01 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=97f5e829-c7d2-45d9-8a7d-75bd07bfe929,created_at=2026-07-09T22:32:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-180006257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=97f5e829-c7d2-45d9-8a7d-75bd07bfe929,host='devstack@QuobyteHD#QuobyteHD',id=2e5b7078-ef09-4688-803c-8cd23eb3d50c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bb50d23c7f248e99990884750f504cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:01Z,use_quota=True,user_id='85d1c2d3ca5642ce927abc6acd6bf672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f69854-7f01-490d-987a-2fe517fa578f),volume_type_id=01f69854-7f01-490d-987a-2fe517fa578f)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:32:01 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Creating volume 2e5b7078-ef09-4688-803c-8cd23eb3d50c {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:32:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:01 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:01 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:01 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:32:01 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:32:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2e5b7078-ef09-4688-803c-8cd23eb3d50c 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:01 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2e5b7078-ef09-4688-803c-8cd23eb3d50c 1073741824 Jul 10 00:32:01 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:02 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2e5b7078-ef09-4688-803c-8cd23eb3d50c 1073741824" returned: 0 in 1.301s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2e5b7078-ef09-4688-803c-8cd23eb3d50c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:02 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2e5b7078-ef09-4688-803c-8cd23eb3d50c Jul 10 00:32:02 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:02 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:32:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Flow 'volume_create_manager' (66ef21a3-548a-48ae-a45b-10f945fb942b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a729ec53-c34d-48bf-ba71-7a8ea219e54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a729ec53-c34d-48bf-ba71-7a8ea219e54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-843792545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c494ae82-d500-4c1e-9f58-2f1dde8b816a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e9fa8afc3c4944b05a4675e6344045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:03Z,use_quota=True,user_id='65c3f96cdd3842d490670801c584d639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9adc7cb6-7141-4003-965e-ee9967b50f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9adc7cb6-7141-4003-965e-ee9967b50f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aa8ab7c-efef-4d47-94ff-4213576224af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aa8ab7c-efef-4d47-94ff-4213576224af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c494ae82-d500-4c1e-9f58-2f1dde8b816a', 'volume_name': 'volume-c494ae82-d500-4c1e-9f58-2f1dde8b816a', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a81a6eb-cc60-4bf1-8f33-6b8710e10d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a81a6eb-cc60-4bf1-8f33-6b8710e10d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ef7b56-344b-4c6d-9817-786fc37d6cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:03 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Volume c494ae82-d500-4c1e-9f58-2f1dde8b816a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c494ae82-d500-4c1e-9f58-2f1dde8b816a', 'volume_size': 1} Jul 10 00:32:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:03 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2e5b7078-ef09-4688-803c-8cd23eb3d50c" returned: 0 in 0.898s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] <== create_volume: return (2264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:32:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.266s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.259s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-843792545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c494ae82-d500-4c1e-9f58-2f1dde8b816a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e9fa8afc3c4944b05a4675e6344045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:03Z,use_quota=True,user_id='65c3f96cdd3842d490670801c584d639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:32:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Creating volume c494ae82-d500-4c1e-9f58-2f1dde8b816a {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:32:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:32:03 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:32:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c494ae82-d500-4c1e-9f58-2f1dde8b816a 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:03 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c494ae82-d500-4c1e-9f58-2f1dde8b816a 1073741824 Jul 10 00:32:03 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7928d46a-e0ca-46df-9676-f37ba30a52fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e5b7078-ef09-4688-803c-8cd23eb3d50c', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8308fc8b-610d-4f29-9a9a-0f020583b799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:03 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Volume volume-2e5b7078-ef09-4688-803c-8cd23eb3d50c (2e5b7078-ef09-4688-803c-8cd23eb3d50c): created successfully Jul 10 00:32:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8308fc8b-610d-4f29-9a9a-0f020583b799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Flow 'volume_create_manager' (045efc53-476a-4cb4-a21d-feac4f8d30e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:03 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-5b2eaaba-a7c0-45ff-b34c-0e0438199ab4 tempest-GroupsTest-1554229273 None] Created volume successfully. Jul 10 00:32:04 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c494ae82-d500-4c1e-9f58-2f1dde8b816a 1073741824" returned: 0 in 1.075s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c494ae82-d500-4c1e-9f58-2f1dde8b816a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:04 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c494ae82-d500-4c1e-9f58-2f1dde8b816a Jul 10 00:32:04 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Flow 'volume_create_manager' (7f55a14f-124b-4ad5-a261-fcab2a7f9d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c075108-5ad5-4627-876e-af1099e4a9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:05 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c494ae82-d500-4c1e-9f58-2f1dde8b816a" returned: 0 in 1.083s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] <== create_volume: return (2209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.212s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c075108-5ad5-4627-876e-af1099e4a9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1452681034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=97f5e829-c7d2-45d9-8a7d-75bd07bfe929,host='devstack@QuobyteHD#QuobyteHD',id=1a79cab8-0ee6-4578-8553-b8fa08c967a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bb50d23c7f248e99990884750f504cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:05Z,use_quota=True,user_id='85d1c2d3ca5642ce927abc6acd6bf672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f69854-7f01-490d-987a-2fe517fa578f),volume_type_id=01f69854-7f01-490d-987a-2fe517fa578f)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ac4e69-9cde-483c-abaf-a6b705179fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ac4e69-9cde-483c-abaf-a6b705179fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6184e9-386f-46cf-b546-6c83c93ffd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6184e9-386f-46cf-b546-6c83c93ffd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a79cab8-0ee6-4578-8553-b8fa08c967a3', 'volume_name': 'volume-1a79cab8-0ee6-4578-8553-b8fa08c967a3', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (518b92db-1600-4044-9223-3187d959b2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (518b92db-1600-4044-9223-3187d959b2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ddc44f3-2d0a-45cf-91db-a664d5e6e722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:05 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Volume 1a79cab8-0ee6-4578-8553-b8fa08c967a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a79cab8-0ee6-4578-8553-b8fa08c967a3', 'volume_size': 1} Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=97f5e829-c7d2-45d9-8a7d-75bd07bfe929,created_at=2026-07-09T22:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1452681034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=97f5e829-c7d2-45d9-8a7d-75bd07bfe929,host='devstack@QuobyteHD#QuobyteHD',id=1a79cab8-0ee6-4578-8553-b8fa08c967a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bb50d23c7f248e99990884750f504cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:05Z,use_quota=True,user_id='85d1c2d3ca5642ce927abc6acd6bf672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f69854-7f01-490d-987a-2fe517fa578f),volume_type_id=01f69854-7f01-490d-987a-2fe517fa578f)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Creating volume 1a79cab8-0ee6-4578-8553-b8fa08c967a3 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:32:05 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1a79cab8-0ee6-4578-8553-b8fa08c967a3 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:05 devstack sudo[98263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1a79cab8-0ee6-4578-8553-b8fa08c967a3 1073741824 Jul 10 00:32:05 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ef7b56-344b-4c6d-9817-786fc37d6cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c494ae82-d500-4c1e-9f58-2f1dde8b816a', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d23c8a5-3d48-4bf3-b32d-83ae787b2e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:05 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Volume volume-c494ae82-d500-4c1e-9f58-2f1dde8b816a (c494ae82-d500-4c1e-9f58-2f1dde8b816a): created successfully Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d23c8a5-3d48-4bf3-b32d-83ae787b2e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:05 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Flow 'volume_create_manager' (66ef21a3-548a-48ae-a45b-10f945fb942b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:05 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-d091c0aa-e767-44a9-8b1d-c1e46ca6ad93 tempest-VolumesTransfersV355Test-1999344184 None] Created volume successfully. Jul 10 00:32:06 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1a79cab8-0ee6-4578-8553-b8fa08c967a3 1073741824" returned: 0 in 1.165s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1a79cab8-0ee6-4578-8553-b8fa08c967a3 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:06 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1a79cab8-0ee6-4578-8553-b8fa08c967a3 Jul 10 00:32:06 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:07 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-2d49c850-3703-4744-9731-038ebb691ba7 tempest-VolumesTransfersV355Test-542134977 None] Transfer volume completed successfully. Jul 10 00:32:07 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1a79cab8-0ee6-4578-8553-b8fa08c967a3" returned: 0 in 0.842s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] <== create_volume: return (2075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:32:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.077s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ddc44f3-2d0a-45cf-91db-a664d5e6e722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a79cab8-0ee6-4578-8553-b8fa08c967a3', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11a6d54e-2775-4a9f-886a-c64d82d16e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:07 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Volume volume-1a79cab8-0ee6-4578-8553-b8fa08c967a3 (1a79cab8-0ee6-4578-8553-b8fa08c967a3): created successfully Jul 10 00:32:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11a6d54e-2775-4a9f-886a-c64d82d16e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Flow 'volume_create_manager' (7f55a14f-124b-4ad5-a261-fcab2a7f9d07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:07 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-e7309099-330d-4afd-be20-dd88751333ab tempest-GroupsTest-1554229273 None] Created volume successfully. Jul 10 00:32:08 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:UPDATE=161,cinder:SELECT=118,cinder:DELETE=9,cinder:INSERT=29 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:32:08 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=135,cinder:INSERT=35,cinder:UPDATE=136,cinder:DELETE=7 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:32:08 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-7521acc1-4fb9-45cd-a054-bd4b29f220f2 tempest-GroupsTest-1554229273 None] Update group completed successfully. Jul 10 00:32:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-296b4488-9f98-4eeb-b2e8-978ef1976679 tempest-VolumesTransfersV355Test-991520928 None] Acquiring lock "cinder-c494ae82-d500-4c1e-9f58-2f1dde8b816a-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-296b4488-9f98-4eeb-b2e8-978ef1976679 tempest-VolumesTransfersV355Test-991520928 None] Lock "cinder-c494ae82-d500-4c1e-9f58-2f1dde8b816a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-296b4488-9f98-4eeb-b2e8-978ef1976679 tempest-VolumesTransfersV355Test-991520928 None] Acquiring lock "cinder-quobyte-c494ae82-d500-4c1e-9f58-2f1dde8b816a" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-296b4488-9f98-4eeb-b2e8-978ef1976679 tempest-VolumesTransfersV355Test-991520928 None] Lock "cinder-quobyte-c494ae82-d500-4c1e-9f58-2f1dde8b816a" acquired by "delete_volume" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:08 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3faafcc-c016-42ad-acd2-9997bc3065c5]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-296b4488-9f98-4eeb-b2e8-978ef1976679 tempest-VolumesTransfersV355Test-991520928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c494ae82-d500-4c1e-9f58-2f1dde8b816a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:08 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c494ae82-d500-4c1e-9f58-2f1dde8b816a Jul 10 00:32:08 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:09 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-9ff7960c-5e3a-4ffe-b17c-0af24b849f03 tempest-GroupsTest-1554229273 None] Update group completed successfully. Jul 10 00:32:09 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-296b4488-9f98-4eeb-b2e8-978ef1976679 tempest-VolumesTransfersV355Test-991520928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c494ae82-d500-4c1e-9f58-2f1dde8b816a" returned: 0 in 0.919s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-296b4488-9f98-4eeb-b2e8-978ef1976679 tempest-VolumesTransfersV355Test-991520928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c494ae82-d500-4c1e-9f58-2f1dde8b816a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:09 devstack sudo[98277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c494ae82-d500-4c1e-9f58-2f1dde8b816a Jul 10 00:32:09 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:10 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-296b4488-9f98-4eeb-b2e8-978ef1976679 tempest-VolumesTransfersV355Test-991520928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c494ae82-d500-4c1e-9f58-2f1dde8b816a" returned: 0 in 0.703s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:10 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-296b4488-9f98-4eeb-b2e8-978ef1976679 tempest-VolumesTransfersV355Test-991520928 None] Lock "cinder-quobyte-c494ae82-d500-4c1e-9f58-2f1dde8b816a" released by "delete_volume" :: held 1.682s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:10 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-296b4488-9f98-4eeb-b2e8-978ef1976679 tempest-VolumesTransfersV355Test-991520928 None] Created reservations ['fd3c0493-804a-4f5a-9246-7cee7a5605cf', '107ed3f1-0bbf-4336-82f8-2b3958c268c0', 'ebec03ed-7360-43e0-818b-5716ae257ca7', 'ca21f960-1252-4284-9159-9aab02498bdb'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:32:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-296b4488-9f98-4eeb-b2e8-978ef1976679 tempest-VolumesTransfersV355Test-991520928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-296b4488-9f98-4eeb-b2e8-978ef1976679 tempest-VolumesTransfersV355Test-991520928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:10 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-296b4488-9f98-4eeb-b2e8-978ef1976679 tempest-VolumesTransfersV355Test-991520928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:10 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-296b4488-9f98-4eeb-b2e8-978ef1976679 tempest-VolumesTransfersV355Test-991520928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-296b4488-9f98-4eeb-b2e8-978ef1976679 tempest-VolumesTransfersV355Test-991520928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-296b4488-9f98-4eeb-b2e8-978ef1976679 tempest-VolumesTransfersV355Test-991520928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:10 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:32:10 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] Acquiring lock "cinder-quobyte-1a79cab8-0ee6-4578-8553-b8fa08c967a3" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] Lock "cinder-quobyte-1a79cab8-0ee6-4578-8553-b8fa08c967a3" acquired by "delete_volume" :: waited 0.030s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:11 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8de08e-b6af-456f-aa65-1d68d9c44dd3]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1a79cab8-0ee6-4578-8553-b8fa08c967a3 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:11 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-296b4488-9f98-4eeb-b2e8-978ef1976679 tempest-VolumesTransfersV355Test-991520928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.889s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:11 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-296b4488-9f98-4eeb-b2e8-978ef1976679 tempest-VolumesTransfersV355Test-991520928 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:32:11 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-296b4488-9f98-4eeb-b2e8-978ef1976679 tempest-VolumesTransfersV355Test-991520928 None] Deleted volume successfully. Jul 10 00:32:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-296b4488-9f98-4eeb-b2e8-978ef1976679 tempest-VolumesTransfersV355Test-991520928 None] Lock "cinder-c494ae82-d500-4c1e-9f58-2f1dde8b816a-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:11 devstack sudo[98284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1a79cab8-0ee6-4578-8553-b8fa08c967a3 Jul 10 00:32:11 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Flow 'volume_create_manager' (3708203c-626e-4cfd-b36d-91832a1508e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89ec5d3-9f44-48d1-9408-a155616079e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89ec5d3-9f44-48d1-9408-a155616079e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1219075655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73eb82b-defc-4157-a5a5-f69fc9dba06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e9fa8afc3c4944b05a4675e6344045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:12Z,use_quota=True,user_id='65c3f96cdd3842d490670801c584d639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1248a9c3-2d2c-4cc9-b7b8-4113f25cab5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1248a9c3-2d2c-4cc9-b7b8-4113f25cab5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eaf0660-3acf-4b40-b4b7-73cbbf997bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eaf0660-3acf-4b40-b4b7-73cbbf997bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b73eb82b-defc-4157-a5a5-f69fc9dba06e', 'volume_name': 'volume-b73eb82b-defc-4157-a5a5-f69fc9dba06e', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (036bb732-eb95-4010-9e75-268d3d693452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (036bb732-eb95-4010-9e75-268d3d693452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (982f9f94-a892-47d2-9cad-18576ddd5c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:12 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Volume b73eb82b-defc-4157-a5a5-f69fc9dba06e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b73eb82b-defc-4157-a5a5-f69fc9dba06e', 'volume_size': 1} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1219075655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b73eb82b-defc-4157-a5a5-f69fc9dba06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e9fa8afc3c4944b05a4675e6344045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:12Z,use_quota=True,user_id='65c3f96cdd3842d490670801c584d639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Creating volume b73eb82b-defc-4157-a5a5-f69fc9dba06e {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:32:12 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b73eb82b-defc-4157-a5a5-f69fc9dba06e 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:12 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b73eb82b-defc-4157-a5a5-f69fc9dba06e 1073741824 Jul 10 00:32:12 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Flow 'volume_create_manager' (16b8f358-9df3-4b38-b294-d1b159e2f4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e67dd671-dbe9-45fe-9ffa-9b838e371cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e67dd671-dbe9-45fe-9ffa-9b838e371cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1768467121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85faac95-ab56-417b-8031-ad6f8402518e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5ce16e2ea64250a272c8feaa4ab8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:12Z,use_quota=True,user_id='7bec9f1bd5444e8f91402148056c142d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c8d188f-ddee-4df0-baad-8aa8d8bf9c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c8d188f-ddee-4df0-baad-8aa8d8bf9c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5ab626-ff1e-4c4f-a466-381364032f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5ab626-ff1e-4c4f-a466-381364032f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85faac95-ab56-417b-8031-ad6f8402518e', 'volume_name': 'volume-85faac95-ab56-417b-8031-ad6f8402518e', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e36903c-6d30-4c31-a8cd-6e0861c3aecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:12 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e36903c-6d30-4c31-a8cd-6e0861c3aecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f090bb4-479a-4c65-91bd-71dbb5f6a0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:12 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Volume 85faac95-ab56-417b-8031-ad6f8402518e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85faac95-ab56-417b-8031-ad6f8402518e', 'volume_size': 1} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1a79cab8-0ee6-4578-8553-b8fa08c967a3" returned: 0 in 1.151s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1a79cab8-0ee6-4578-8553-b8fa08c967a3 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:12 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1a79cab8-0ee6-4578-8553-b8fa08c967a3 Jul 10 00:32:12 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:13 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:13 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b73eb82b-defc-4157-a5a5-f69fc9dba06e 1073741824" returned: 0 in 1.041s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1a79cab8-0ee6-4578-8553-b8fa08c967a3" returned: 0 in 0.749s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:13 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] Lock "cinder-quobyte-1a79cab8-0ee6-4578-8553-b8fa08c967a3" released by "delete_volume" :: held 1.970s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:13 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] Acquiring lock "cinder-quobyte-2e5b7078-ef09-4688-803c-8cd23eb3d50c" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:13 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] Lock "cinder-quobyte-2e5b7078-ef09-4688-803c-8cd23eb3d50c" acquired by "delete_volume" :: waited 0.023s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b73eb82b-defc-4157-a5a5-f69fc9dba06e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:13 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ce3d0b-bf93-482c-8ca8-1ec8cf06adc4]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2e5b7078-ef09-4688-803c-8cd23eb3d50c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:13 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b73eb82b-defc-4157-a5a5-f69fc9dba06e Jul 10 00:32:13 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:13 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2e5b7078-ef09-4688-803c-8cd23eb3d50c Jul 10 00:32:13 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:13 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:32:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Flow 'volume_create_manager' (97dd584d-c703-427e-91af-1461b9a4c0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d768a5f-c04d-4079-9139-2163e3618391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d768a5f-c04d-4079-9139-2163e3618391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1316823910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c78117f-87ee-44f0-9514-4d7b678eefc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b8af0095e542108fc1a908f541c67b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:14Z,use_quota=True,user_id='e1400f94be894444a0249067aebddba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba1be11-0549-4c99-aa03-63ed20573522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ba1be11-0549-4c99-aa03-63ed20573522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da81e7a7-ddae-4951-a2f8-7fe86d1d778c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da81e7a7-ddae-4951-a2f8-7fe86d1d778c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c78117f-87ee-44f0-9514-4d7b678eefc7', 'volume_name': 'volume-4c78117f-87ee-44f0-9514-4d7b678eefc7', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22545524-95d7-48e4-b814-2a58c71f93e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22545524-95d7-48e4-b814-2a58c71f93e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47101083-b394-407e-a519-4638a3816800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:13 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Volume 4c78117f-87ee-44f0-9514-4d7b678eefc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c78117f-87ee-44f0-9514-4d7b678eefc7', 'volume_size': 1} Jul 10 00:32:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:14 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b73eb82b-defc-4157-a5a5-f69fc9dba06e" returned: 0 in 0.763s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:32:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.578s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1768467121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85faac95-ab56-417b-8031-ad6f8402518e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5ce16e2ea64250a272c8feaa4ab8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:12Z,use_quota=True,user_id='7bec9f1bd5444e8f91402148056c142d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:32:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Creating volume 85faac95-ab56-417b-8031-ad6f8402518e {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:32:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:32:14 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:32:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-85faac95-ab56-417b-8031-ad6f8402518e 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:14 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-85faac95-ab56-417b-8031-ad6f8402518e 1073741824 Jul 10 00:32:14 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:14 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (982f9f94-a892-47d2-9cad-18576ddd5c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b73eb82b-defc-4157-a5a5-f69fc9dba06e', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acce8c37-618f-43fd-80e3-b46649903a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2e5b7078-ef09-4688-803c-8cd23eb3d50c" returned: 0 in 0.817s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2e5b7078-ef09-4688-803c-8cd23eb3d50c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:14 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Volume volume-b73eb82b-defc-4157-a5a5-f69fc9dba06e (b73eb82b-defc-4157-a5a5-f69fc9dba06e): created successfully Jul 10 00:32:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acce8c37-618f-43fd-80e3-b46649903a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:14 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2e5b7078-ef09-4688-803c-8cd23eb3d50c Jul 10 00:32:14 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Flow 'volume_create_manager' (3708203c-626e-4cfd-b36d-91832a1508e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:14 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-b0d105ab-727c-4cbd-a94b-15d2b228eeb4 tempest-VolumesTransfersV355Test-1999344184 None] Created volume successfully. Jul 10 00:32:14 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2e5b7078-ef09-4688-803c-8cd23eb3d50c" returned: 0 in 0.664s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:14 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] Lock "cinder-quobyte-2e5b7078-ef09-4688-803c-8cd23eb3d50c" released by "delete_volume" :: held 1.536s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:14 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] Created reservations ['bd281d75-6657-42dd-b216-af1a45843e1d'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:32:14 devstack cinder-volume[88119]: WARNING cinder.quota [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1105386853 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1105386853, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:32:14 devstack cinder-volume[88119]: WARNING cinder.quota [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1105386853 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1105386853, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:32:14 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] Created reservations ['54681578-2e1a-42f6-81bc-63178af71ffb', '16a018c9-1abd-4a13-ac2c-b263e1c13164', 'bae0ff0c-84ed-49e7-b762-c881b9708b4f', 'd0b87e3d-14c1-4fbc-ad94-bc965d7410fc'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:32:15 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-85faac95-ab56-417b-8031-ad6f8402518e 1073741824" returned: 0 in 0.905s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-85faac95-ab56-417b-8031-ad6f8402518e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:15 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-85faac95-ab56-417b-8031-ad6f8402518e Jul 10 00:32:15 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] Created reservations ['e10b9f56-1a17-4ff4-838f-3ef757b9e778', '77cc55ab-f9b4-48e2-86ef-373ab1c517f6', '4de295e0-157b-4549-a8eb-aa662b88bebf', 'eaaa645e-4736-411b-a0a9-a9de2e2f2b17'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:15 devstack sudo[98319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:32:15 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-6c1dafb8-39f6-4f3e-9270-9a2d04c81758 tempest-VolumesTransfersV355Test-991520928 None] Acquiring lock "cinder-b73eb82b-defc-4157-a5a5-f69fc9dba06e-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-6c1dafb8-39f6-4f3e-9270-9a2d04c81758 tempest-VolumesTransfersV355Test-991520928 None] Lock "cinder-b73eb82b-defc-4157-a5a5-f69fc9dba06e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-6c1dafb8-39f6-4f3e-9270-9a2d04c81758 tempest-VolumesTransfersV355Test-991520928 None] Acquiring lock "cinder-quobyte-b73eb82b-defc-4157-a5a5-f69fc9dba06e" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-6c1dafb8-39f6-4f3e-9270-9a2d04c81758 tempest-VolumesTransfersV355Test-991520928 None] Lock "cinder-quobyte-b73eb82b-defc-4157-a5a5-f69fc9dba06e" acquired by "delete_volume" :: waited 0.014s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[271ce459-5c99-4a02-86f2-c09e7c652f81]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6c1dafb8-39f6-4f3e-9270-9a2d04c81758 tempest-VolumesTransfersV355Test-991520928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b73eb82b-defc-4157-a5a5-f69fc9dba06e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:15 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b73eb82b-defc-4157-a5a5-f69fc9dba06e Jul 10 00:32:15 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:15 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-85faac95-ab56-417b-8031-ad6f8402518e" returned: 0 in 0.695s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.817s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1316823910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c78117f-87ee-44f0-9514-4d7b678eefc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b8af0095e542108fc1a908f541c67b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:14Z,use_quota=True,user_id='e1400f94be894444a0249067aebddba2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Creating volume 4c78117f-87ee-44f0-9514-4d7b678eefc7 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:32:15 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:15 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7 1073741824 Jul 10 00:32:15 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f090bb4-479a-4c65-91bd-71dbb5f6a0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85faac95-ab56-417b-8031-ad6f8402518e', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f03d36e-b00b-4689-972f-ab13fe1c6955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:15 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Volume volume-85faac95-ab56-417b-8031-ad6f8402518e (85faac95-ab56-417b-8031-ad6f8402518e): created successfully Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f03d36e-b00b-4689-972f-ab13fe1c6955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:15 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Flow 'volume_create_manager' (16b8f358-9df3-4b38-b294-d1b159e2f4e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:15 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-6157b9e2-da8f-47a0-a8a6-cbb953101f0d tempest-VolumesListAdminTestJSON-685103889 None] Created volume successfully. Jul 10 00:32:16 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.734s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:16 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:32:16 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-29dc74a8-db29-44af-a60d-6809b21ed209 tempest-GroupsTest-1554229273 None] Delete group completed successfully. Jul 10 00:32:16 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6c1dafb8-39f6-4f3e-9270-9a2d04c81758 tempest-VolumesTransfersV355Test-991520928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b73eb82b-defc-4157-a5a5-f69fc9dba06e" returned: 0 in 0.935s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6c1dafb8-39f6-4f3e-9270-9a2d04c81758 tempest-VolumesTransfersV355Test-991520928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b73eb82b-defc-4157-a5a5-f69fc9dba06e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:16 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b73eb82b-defc-4157-a5a5-f69fc9dba06e Jul 10 00:32:16 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:16 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7 1073741824" returned: 0 in 1.010s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:16 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7 Jul 10 00:32:16 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Flow 'volume_create_manager' (fe5e6706-4305-40e0-b6a0-8509102c8658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68811577-195c-4021-9741-424a1d7cff5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68811577-195c-4021-9741-424a1d7cff5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-872701459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8939b2cb-4ed3-4a96-9bdc-ca59f962305f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5ce16e2ea64250a272c8feaa4ab8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:17Z,use_quota=True,user_id='7bec9f1bd5444e8f91402148056c142d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578b4c26-5e57-4635-a56b-58837a6b454f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578b4c26-5e57-4635-a56b-58837a6b454f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cf0e218-da35-4fe2-9479-49fd554edcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cf0e218-da35-4fe2-9479-49fd554edcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8939b2cb-4ed3-4a96-9bdc-ca59f962305f', 'volume_name': 'volume-8939b2cb-4ed3-4a96-9bdc-ca59f962305f', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee8c8387-0e8a-43fd-8a7e-f905fe79aeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee8c8387-0e8a-43fd-8a7e-f905fe79aeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee9e6b16-87bb-461c-b0f0-011463787817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:17 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Volume 8939b2cb-4ed3-4a96-9bdc-ca59f962305f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8939b2cb-4ed3-4a96-9bdc-ca59f962305f', 'volume_size': 1} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:17 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6c1dafb8-39f6-4f3e-9270-9a2d04c81758 tempest-VolumesTransfersV355Test-991520928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b73eb82b-defc-4157-a5a5-f69fc9dba06e" returned: 0 in 0.758s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-6c1dafb8-39f6-4f3e-9270-9a2d04c81758 tempest-VolumesTransfersV355Test-991520928 None] Lock "cinder-quobyte-b73eb82b-defc-4157-a5a5-f69fc9dba06e" released by "delete_volume" :: held 1.736s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-6c1dafb8-39f6-4f3e-9270-9a2d04c81758 tempest-VolumesTransfersV355Test-991520928 None] Created reservations ['37feed0f-f1a9-4d3a-b96a-1de13cf36256', 'f9eba375-2184-40dc-9e88-9dda53c935cb', 'fdf00e74-566b-4751-add6-b5508bb296c2', '77e3d272-c465-4f82-a382-9ef79b56d8c3'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6c1dafb8-39f6-4f3e-9270-9a2d04c81758 tempest-VolumesTransfersV355Test-991520928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6c1dafb8-39f6-4f3e-9270-9a2d04c81758 tempest-VolumesTransfersV355Test-991520928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-6c1dafb8-39f6-4f3e-9270-9a2d04c81758 tempest-VolumesTransfersV355Test-991520928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-6c1dafb8-39f6-4f3e-9270-9a2d04c81758 tempest-VolumesTransfersV355Test-991520928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6c1dafb8-39f6-4f3e-9270-9a2d04c81758 tempest-VolumesTransfersV355Test-991520928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6c1dafb8-39f6-4f3e-9270-9a2d04c81758 tempest-VolumesTransfersV355Test-991520928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:17 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:32:17 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:17 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7" returned: 0 in 0.774s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.429s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-872701459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8939b2cb-4ed3-4a96-9bdc-ca59f962305f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5ce16e2ea64250a272c8feaa4ab8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:17Z,use_quota=True,user_id='7bec9f1bd5444e8f91402148056c142d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Creating volume 8939b2cb-4ed3-4a96-9bdc-ca59f962305f {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:32:17 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8939b2cb-4ed3-4a96-9bdc-ca59f962305f 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:17 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8939b2cb-4ed3-4a96-9bdc-ca59f962305f 1073741824 Jul 10 00:32:17 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47101083-b394-407e-a519-4638a3816800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c78117f-87ee-44f0-9514-4d7b678eefc7', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ca3a25-88a7-4ccd-81c3-5db577c55a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:17 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Volume volume-4c78117f-87ee-44f0-9514-4d7b678eefc7 (4c78117f-87ee-44f0-9514-4d7b678eefc7): created successfully Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ca3a25-88a7-4ccd-81c3-5db577c55a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Flow 'volume_create_manager' (97dd584d-c703-427e-91af-1461b9a4c0ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:17 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-d35bdf86-ed18-48f0-8f7f-65a3e9a7472d tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Created volume successfully. Jul 10 00:32:18 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6c1dafb8-39f6-4f3e-9270-9a2d04c81758 tempest-VolumesTransfersV355Test-991520928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.747s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:18 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-6c1dafb8-39f6-4f3e-9270-9a2d04c81758 tempest-VolumesTransfersV355Test-991520928 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:32:18 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-6c1dafb8-39f6-4f3e-9270-9a2d04c81758 tempest-VolumesTransfersV355Test-991520928 None] Deleted volume successfully. Jul 10 00:32:18 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-6c1dafb8-39f6-4f3e-9270-9a2d04c81758 tempest-VolumesTransfersV355Test-991520928 None] Lock "cinder-b73eb82b-defc-4157-a5a5-f69fc9dba06e-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9cb3e594-df95-4502-a65b-c122fa4d6415 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:18 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8939b2cb-4ed3-4a96-9bdc-ca59f962305f 1073741824" returned: 0 in 1.246s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8939b2cb-4ed3-4a96-9bdc-ca59f962305f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:18 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8939b2cb-4ed3-4a96-9bdc-ca59f962305f Jul 10 00:32:18 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:19 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8939b2cb-4ed3-4a96-9bdc-ca59f962305f" returned: 0 in 0.748s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:32:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9cb3e594-df95-4502-a65b-c122fa4d6415 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.225s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-9cb3e594-df95-4502-a65b-c122fa4d6415 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Creating offline snapshot f8cc36c9-2a37-47eb-afd4-d84a9e13cf92 of volume 4c78117f-87ee-44f0-9514-4d7b678eefc7 {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:32:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee9e6b16-87bb-461c-b0f0-011463787817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8939b2cb-4ed3-4a96-9bdc-ca59f962305f', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38a58430-16fd-406e-a258-517e06e9970a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:19 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4168f2d5-1499-47e0-ad6c-6cd577383f8a]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9cb3e594-df95-4502-a65b-c122fa4d6415 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:19 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Volume volume-8939b2cb-4ed3-4a96-9bdc-ca59f962305f (8939b2cb-4ed3-4a96-9bdc-ca59f962305f): created successfully Jul 10 00:32:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38a58430-16fd-406e-a258-517e06e9970a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Flow 'volume_create_manager' (fe5e6706-4305-40e0-b6a0-8509102c8658) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:19 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-a1b35d58-20fd-4d1c-979a-158fab6585b9 tempest-VolumesListAdminTestJSON-685103889 None] Created volume successfully. Jul 10 00:32:19 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7 Jul 10 00:32:19 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:20 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9cb3e594-df95-4502-a65b-c122fa4d6415 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7" returned: 0 in 1.064s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9cb3e594-df95-4502-a65b-c122fa4d6415 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.f8cc36c9-2a37-47eb-afd4-d84a9e13cf92 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:20 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.f8cc36c9-2a37-47eb-afd4-d84a9e13cf92 1G Jul 10 00:32:20 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:20 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:32:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Flow 'volume_create_manager' (69c7ef5e-34c4-4327-b8cb-faca38d390f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3cb0324-582b-4c5b-8456-ab5e7b134ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:21 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3cb0324-582b-4c5b-8456-ab5e7b134ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-354077861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bade946-c6f0-48ed-a012-9adf4c5e5869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5ce16e2ea64250a272c8feaa4ab8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:21Z,use_quota=True,user_id='7bec9f1bd5444e8f91402148056c142d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:21 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d87a0877-003e-4fbc-8e45-29fbfbf3029a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:21 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d87a0877-003e-4fbc-8e45-29fbfbf3029a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:21 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e26d3f25-6837-4b9a-bf9a-1dde338e47b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:21 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e26d3f25-6837-4b9a-bf9a-1dde338e47b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bade946-c6f0-48ed-a012-9adf4c5e5869', 'volume_name': 'volume-6bade946-c6f0-48ed-a012-9adf4c5e5869', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:21 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c2ac25-8821-44e7-b3ba-9c859910cf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:21 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c2ac25-8821-44e7-b3ba-9c859910cf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:21 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec2b30ec-2d92-4aef-a56a-0ba4238539db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:21 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Volume 6bade946-c6f0-48ed-a012-9adf4c5e5869: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bade946-c6f0-48ed-a012-9adf4c5e5869', 'volume_size': 1} Jul 10 00:32:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:21 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9cb3e594-df95-4502-a65b-c122fa4d6415 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.f8cc36c9-2a37-47eb-afd4-d84a9e13cf92 1G" returned: 0 in 0.962s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9cb3e594-df95-4502-a65b-c122fa4d6415 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c78117f-87ee-44f0-9514-4d7b678eefc7 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.f8cc36c9-2a37-47eb-afd4-d84a9e13cf92 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:21 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c78117f-87ee-44f0-9514-4d7b678eefc7 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.f8cc36c9-2a37-47eb-afd4-d84a9e13cf92 Jul 10 00:32:21 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:22 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9cb3e594-df95-4502-a65b-c122fa4d6415 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c78117f-87ee-44f0-9514-4d7b678eefc7 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.f8cc36c9-2a37-47eb-afd4-d84a9e13cf92" returned: 0 in 0.775s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:22 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-9cb3e594-df95-4502-a65b-c122fa4d6415 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.f8cc36c9-2a37-47eb-afd4-d84a9e13cf92 is being set with open permissions: ugo+rw Jul 10 00:32:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9cb3e594-df95-4502-a65b-c122fa4d6415 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.f8cc36c9-2a37-47eb-afd4-d84a9e13cf92 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:22 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.f8cc36c9-2a37-47eb-afd4-d84a9e13cf92 Jul 10 00:32:22 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:23 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9cb3e594-df95-4502-a65b-c122fa4d6415 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.f8cc36c9-2a37-47eb-afd4-d84a9e13cf92" returned: 0 in 0.709s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9cb3e594-df95-4502-a65b-c122fa4d6415 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:23 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.info Jul 10 00:32:23 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:23 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9cb3e594-df95-4502-a65b-c122fa4d6415 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.info" returned: 0 in 0.706s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:23 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-9cb3e594-df95-4502-a65b-c122fa4d6415 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.info is being set with open permissions: ugo+rw Jul 10 00:32:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9cb3e594-df95-4502-a65b-c122fa4d6415 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:24 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.info Jul 10 00:32:24 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:24 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9cb3e594-df95-4502-a65b-c122fa4d6415 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.info" returned: 0 in 0.680s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9cb3e594-df95-4502-a65b-c122fa4d6415 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.016s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.643s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-354077861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bade946-c6f0-48ed-a012-9adf4c5e5869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5ce16e2ea64250a272c8feaa4ab8aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:21Z,use_quota=True,user_id='7bec9f1bd5444e8f91402148056c142d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:32:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Creating volume 6bade946-c6f0-48ed-a012-9adf4c5e5869 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:32:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:32:24 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:32:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6bade946-c6f0-48ed-a012-9adf4c5e5869 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:24 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6bade946-c6f0-48ed-a012-9adf4c5e5869 1073741824 Jul 10 00:32:24 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:24 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-9cb3e594-df95-4502-a65b-c122fa4d6415 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Create snapshot completed successfully Jul 10 00:32:25 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6bade946-c6f0-48ed-a012-9adf4c5e5869 1073741824" returned: 0 in 1.019s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:25 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:32:25 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Flow 'volume_create_manager' (c6c81d2c-c202-49d9-9e16-60dfc778eed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:25 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef80d6bd-2e8f-446b-bb87-4c01eb9b274f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6bade946-c6f0-48ed-a012-9adf4c5e5869 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:25 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef80d6bd-2e8f-446b-bb87-4c01eb9b274f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1517291994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=856c0e27-a05d-4c15-9d44-213749dcc62b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2f7ad4969454f9791d76c0cf01e454b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:26Z,use_quota=True,user_id='3d6d90f4350c45e2a71bcd6663286e58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:25 devstack sudo[98386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6bade946-c6f0-48ed-a012-9adf4c5e5869 Jul 10 00:32:25 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:25 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d96757-0ff4-4165-b8e1-0fec19c7b7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:25 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d96757-0ff4-4165-b8e1-0fec19c7b7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:25 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03321a4e-5ba0-49e8-b014-9f35616356bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:25 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03321a4e-5ba0-49e8-b014-9f35616356bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '856c0e27-a05d-4c15-9d44-213749dcc62b', 'volume_name': 'volume-856c0e27-a05d-4c15-9d44-213749dcc62b', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:25 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac9317b-2487-4e39-98bf-c2526d444ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:25 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac9317b-2487-4e39-98bf-c2526d444ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:25 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1dbd29f-317f-4f6f-bd5f-3d4412b535cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:25 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Volume 856c0e27-a05d-4c15-9d44-213749dcc62b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-856c0e27-a05d-4c15-9d44-213749dcc62b', 'volume_size': 1} Jul 10 00:32:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2171be26-4ab6-4b5b-93c5-3fd367de516f tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Acquiring lock "cinder-f8cc36c9-2a37-47eb-afd4-d84a9e13cf92-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2171be26-4ab6-4b5b-93c5-3fd367de516f tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Lock "cinder-f8cc36c9-2a37-47eb-afd4-d84a9e13cf92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2171be26-4ab6-4b5b-93c5-3fd367de516f tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Acquiring lock "cinder-quobyte-4c78117f-87ee-44f0-9514-4d7b678eefc7" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2171be26-4ab6-4b5b-93c5-3fd367de516f tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Lock "cinder-quobyte-4c78117f-87ee-44f0-9514-4d7b678eefc7" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2171be26-4ab6-4b5b-93c5-3fd367de516f tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Acquiring lock "cinder-quobyte-f8cc36c9-2a37-47eb-afd4-d84a9e13cf92" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2171be26-4ab6-4b5b-93c5-3fd367de516f tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Lock "cinder-quobyte-f8cc36c9-2a37-47eb-afd4-d84a9e13cf92" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-2171be26-4ab6-4b5b-93c5-3fd367de516f tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Deleting offline snapshot f8cc36c9-2a37-47eb-afd4-d84a9e13cf92 of volume 4c78117f-87ee-44f0-9514-4d7b678eefc7 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-2171be26-4ab6-4b5b-93c5-3fd367de516f tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] snapshot_file for this snap is: volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.f8cc36c9-2a37-47eb-afd4-d84a9e13cf92 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6962d064-b51c-44a6-8d31-a2ec4ef25dd5]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2171be26-4ab6-4b5b-93c5-3fd367de516f tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.f8cc36c9-2a37-47eb-afd4-d84a9e13cf92 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:26 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6bade946-c6f0-48ed-a012-9adf4c5e5869" returned: 0 in 0.763s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] <== create_volume: return (1900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.902s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.662s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1517291994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=856c0e27-a05d-4c15-9d44-213749dcc62b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2f7ad4969454f9791d76c0cf01e454b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:26Z,use_quota=True,user_id='3d6d90f4350c45e2a71bcd6663286e58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Creating volume 856c0e27-a05d-4c15-9d44-213749dcc62b {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:32:26 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-856c0e27-a05d-4c15-9d44-213749dcc62b 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:26 devstack sudo[98390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.f8cc36c9-2a37-47eb-afd4-d84a9e13cf92 Jul 10 00:32:26 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:26 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-856c0e27-a05d-4c15-9d44-213749dcc62b 1073741824 Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec2b30ec-2d92-4aef-a56a-0ba4238539db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bade946-c6f0-48ed-a012-9adf4c5e5869', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:26 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c50229-d3af-4af1-b1cd-6788b6f478a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:26 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Volume volume-6bade946-c6f0-48ed-a012-9adf4c5e5869 (6bade946-c6f0-48ed-a012-9adf4c5e5869): created successfully Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c50229-d3af-4af1-b1cd-6788b6f478a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Flow 'volume_create_manager' (69c7ef5e-34c4-4327-b8cb-faca38d390f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:26 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-0967ade7-802c-47bf-ac97-3b5d8e60ee50 tempest-VolumesListAdminTestJSON-685103889 None] Created volume successfully. Jul 10 00:32:27 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2171be26-4ab6-4b5b-93c5-3fd367de516f tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.f8cc36c9-2a37-47eb-afd4-d84a9e13cf92" returned: 0 in 0.867s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:27 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-2171be26-4ab6-4b5b-93c5-3fd367de516f tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c78117f-87ee-44f0-9514-4d7b678eefc7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:32:27 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[63717601-3036-4b8e-9f59-77002cf4b421]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2171be26-4ab6-4b5b-93c5-3fd367de516f tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:27 devstack sudo[98402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7 Jul 10 00:32:27 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:27 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-856c0e27-a05d-4c15-9d44-213749dcc62b 1073741824" returned: 0 in 1.087s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-856c0e27-a05d-4c15-9d44-213749dcc62b {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:27 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-856c0e27-a05d-4c15-9d44-213749dcc62b Jul 10 00:32:27 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:28 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2171be26-4ab6-4b5b-93c5-3fd367de516f tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7" returned: 0 in 0.954s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2171be26-4ab6-4b5b-93c5-3fd367de516f tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.f8cc36c9-2a37-47eb-afd4-d84a9e13cf92 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:28 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.f8cc36c9-2a37-47eb-afd4-d84a9e13cf92 Jul 10 00:32:28 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Flow 'volume_create_manager' (0e013cd8-27dd-4965-a143-571c6bb88484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec2d4f36-e44a-4f1c-b519-d1f044896f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec2d4f36-e44a-4f1c-b519-d1f044896f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb361cd-bfa1-40f1-981a-da078c0efbc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6c06e8e721e4086b40642e25a894fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:28Z,use_quota=True,user_id='3ff39d4ec3bb45ad9bc4079ed709d5fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5866f84-b6bc-4363-b4df-919898fac0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5866f84-b6bc-4363-b4df-919898fac0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f650a2a4-d442-4102-b195-88f4fcf9f46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f650a2a4-d442-4102-b195-88f4fcf9f46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cb361cd-bfa1-40f1-981a-da078c0efbc0', 'volume_name': 'volume-7cb361cd-bfa1-40f1-981a-da078c0efbc0', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df7bed6-d6cb-4bed-84c8-d7b4467ec140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df7bed6-d6cb-4bed-84c8-d7b4467ec140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddf9cb70-2a1f-443b-9b14-44cc3b45269b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:28 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Volume 7cb361cd-bfa1-40f1-981a-da078c0efbc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cb361cd-bfa1-40f1-981a-da078c0efbc0', 'volume_size': 1} Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:28 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-856c0e27-a05d-4c15-9d44-213749dcc62b" returned: 0 in 0.815s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.032s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb361cd-bfa1-40f1-981a-da078c0efbc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6c06e8e721e4086b40642e25a894fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:28Z,use_quota=True,user_id='3ff39d4ec3bb45ad9bc4079ed709d5fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Creating volume 7cb361cd-bfa1-40f1-981a-da078c0efbc0 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:32:28 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7cb361cd-bfa1-40f1-981a-da078c0efbc0 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:28 devstack sudo[98412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7cb361cd-bfa1-40f1-981a-da078c0efbc0 1073741824 Jul 10 00:32:28 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1dbd29f-317f-4f6f-bd5f-3d4412b535cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-856c0e27-a05d-4c15-9d44-213749dcc62b', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (563530ba-ad5b-4c31-b245-6f536f1ca5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:28 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Volume volume-856c0e27-a05d-4c15-9d44-213749dcc62b (856c0e27-a05d-4c15-9d44-213749dcc62b): created successfully Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (563530ba-ad5b-4c31-b245-6f536f1ca5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Flow 'volume_create_manager' (c6c81d2c-c202-49d9-9e16-60dfc778eed5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:28 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-4c90d333-20da-4c9b-b93f-eb4c24629b3d tempest-VolumesTransfersV357Test-2089884021 None] Created volume successfully. Jul 10 00:32:29 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2171be26-4ab6-4b5b-93c5-3fd367de516f tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.f8cc36c9-2a37-47eb-afd4-d84a9e13cf92" returned: 0 in 0.877s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2171be26-4ab6-4b5b-93c5-3fd367de516f tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.f8cc36c9-2a37-47eb-afd4-d84a9e13cf92 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:29 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.f8cc36c9-2a37-47eb-afd4-d84a9e13cf92 Jul 10 00:32:29 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:29 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-c034ded2-3f80-4619-8f02-5a93daa6be9f tempest-VolumesTransfersV357Test-712971252 None] Transfer volume completed successfully. Jul 10 00:32:29 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7cb361cd-bfa1-40f1-981a-da078c0efbc0 1073741824" returned: 0 in 1.094s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7cb361cd-bfa1-40f1-981a-da078c0efbc0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:29 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7cb361cd-bfa1-40f1-981a-da078c0efbc0 Jul 10 00:32:29 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:30 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2171be26-4ab6-4b5b-93c5-3fd367de516f tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7.f8cc36c9-2a37-47eb-afd4-d84a9e13cf92" returned: 0 in 0.809s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:30 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2171be26-4ab6-4b5b-93c5-3fd367de516f tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Lock "cinder-quobyte-f8cc36c9-2a37-47eb-afd4-d84a9e13cf92" released by "_delete_snapshot" :: held 3.646s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:30 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2171be26-4ab6-4b5b-93c5-3fd367de516f tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Lock "cinder-quobyte-4c78117f-87ee-44f0-9514-4d7b678eefc7" released by "delete_snapshot" :: held 3.669s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:30 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-2171be26-4ab6-4b5b-93c5-3fd367de516f tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Created reservations ['546c51a6-4231-4653-8688-90507cff2f81', '74a60360-c67b-4c57-9f78-c716c889422a', 'b8066a9a-eea6-46f2-bb94-0797cad3db46', '5c9f1e3d-5360-4427-a33f-3d9ed252483e'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:32:30 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-2171be26-4ab6-4b5b-93c5-3fd367de516f tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Delete snapshot completed successfully. Jul 10 00:32:30 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2171be26-4ab6-4b5b-93c5-3fd367de516f tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Lock "cinder-f8cc36c9-2a37-47eb-afd4-d84a9e13cf92-delete_snapshot" released by "delete_snapshot" :: held 3.868s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:30 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7cb361cd-bfa1-40f1-981a-da078c0efbc0" returned: 0 in 0.739s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:30 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:32:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddf9cb70-2a1f-443b-9b14-44cc3b45269b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cb361cd-bfa1-40f1-981a-da078c0efbc0', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c428ba1-67a8-4816-8815-b7352ca00c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:30 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Volume volume-7cb361cd-bfa1-40f1-981a-da078c0efbc0 (7cb361cd-bfa1-40f1-981a-da078c0efbc0): created successfully Jul 10 00:32:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c428ba1-67a8-4816-8815-b7352ca00c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Flow 'volume_create_manager' (0e013cd8-27dd-4965-a143-571c6bb88484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:30 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-47d52e45-f119-4e46-98e5-7bedae4a7ad2 tempest-VolumesListAdminTestJSON-221878611 None] Created volume successfully. Jul 10 00:32:30 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-159cf0d4-80d5-4d28-820a-2846889490e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Acquiring lock "cinder-4c78117f-87ee-44f0-9514-4d7b678eefc7-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:30 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-159cf0d4-80d5-4d28-820a-2846889490e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Lock "cinder-4c78117f-87ee-44f0-9514-4d7b678eefc7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:30 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-159cf0d4-80d5-4d28-820a-2846889490e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Acquiring lock "cinder-quobyte-4c78117f-87ee-44f0-9514-4d7b678eefc7" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:30 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-159cf0d4-80d5-4d28-820a-2846889490e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Lock "cinder-quobyte-4c78117f-87ee-44f0-9514-4d7b678eefc7" acquired by "delete_volume" :: waited 0.014s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:30 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e1add614-31d0-4a26-8e44-2a2cc12cefbc tempest-VolumesTransfersV357Test-1484971429 None] Acquiring lock "cinder-856c0e27-a05d-4c15-9d44-213749dcc62b-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:30 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[40999136-88cb-4bc1-a8a1-733194cc420d]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-159cf0d4-80d5-4d28-820a-2846889490e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:30 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e1add614-31d0-4a26-8e44-2a2cc12cefbc tempest-VolumesTransfersV357Test-1484971429 None] Lock "cinder-856c0e27-a05d-4c15-9d44-213749dcc62b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:30 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e1add614-31d0-4a26-8e44-2a2cc12cefbc tempest-VolumesTransfersV357Test-1484971429 None] Acquiring lock "cinder-quobyte-856c0e27-a05d-4c15-9d44-213749dcc62b" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:30 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e1add614-31d0-4a26-8e44-2a2cc12cefbc tempest-VolumesTransfersV357Test-1484971429 None] Lock "cinder-quobyte-856c0e27-a05d-4c15-9d44-213749dcc62b" acquired by "delete_volume" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:31 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6214a623-d425-4c09-89f3-378bcbdf17f1]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e1add614-31d0-4a26-8e44-2a2cc12cefbc tempest-VolumesTransfersV357Test-1484971429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-856c0e27-a05d-4c15-9d44-213749dcc62b {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:31 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7 Jul 10 00:32:31 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:31 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-856c0e27-a05d-4c15-9d44-213749dcc62b Jul 10 00:32:31 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:32:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:31 devstack sudo[98435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:32:31 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:31 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c202bc7f-36b3-42b6-8975-98e8b55f5bd8 tempest-VolumesListAdminTestJSON-221878611 None] Acquiring lock "cinder-7cb361cd-bfa1-40f1-981a-da078c0efbc0-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:31 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c202bc7f-36b3-42b6-8975-98e8b55f5bd8 tempest-VolumesListAdminTestJSON-221878611 None] Lock "cinder-7cb361cd-bfa1-40f1-981a-da078c0efbc0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:31 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-159cf0d4-80d5-4d28-820a-2846889490e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7" returned: 0 in 0.954s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-159cf0d4-80d5-4d28-820a-2846889490e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:31 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c202bc7f-36b3-42b6-8975-98e8b55f5bd8 tempest-VolumesListAdminTestJSON-221878611 None] Acquiring lock "cinder-quobyte-7cb361cd-bfa1-40f1-981a-da078c0efbc0" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:31 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7 Jul 10 00:32:31 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c202bc7f-36b3-42b6-8975-98e8b55f5bd8 tempest-VolumesListAdminTestJSON-221878611 None] Lock "cinder-quobyte-7cb361cd-bfa1-40f1-981a-da078c0efbc0" acquired by "delete_volume" :: waited 0.030s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:31 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:31 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[03043fb0-d937-4132-b0c3-493a48d2a7b3]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c202bc7f-36b3-42b6-8975-98e8b55f5bd8 tempest-VolumesListAdminTestJSON-221878611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7cb361cd-bfa1-40f1-981a-da078c0efbc0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a7aea59e-4833-4734-a01c-ae39e542c159 tempest-VolumesListAdminTestJSON-685103889 None] Acquiring lock "cinder-6bade946-c6f0-48ed-a012-9adf4c5e5869-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a7aea59e-4833-4734-a01c-ae39e542c159 tempest-VolumesListAdminTestJSON-685103889 None] Lock "cinder-6bade946-c6f0-48ed-a012-9adf4c5e5869-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:32 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e1add614-31d0-4a26-8e44-2a2cc12cefbc tempest-VolumesTransfersV357Test-1484971429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-856c0e27-a05d-4c15-9d44-213749dcc62b" returned: 0 in 1.120s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e1add614-31d0-4a26-8e44-2a2cc12cefbc tempest-VolumesTransfersV357Test-1484971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-856c0e27-a05d-4c15-9d44-213749dcc62b {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:32 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7cb361cd-bfa1-40f1-981a-da078c0efbc0 Jul 10 00:32:32 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:32 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-856c0e27-a05d-4c15-9d44-213749dcc62b Jul 10 00:32:32 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a7aea59e-4833-4734-a01c-ae39e542c159 tempest-VolumesListAdminTestJSON-685103889 None] Acquiring lock "cinder-quobyte-6bade946-c6f0-48ed-a012-9adf4c5e5869" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a7aea59e-4833-4734-a01c-ae39e542c159 tempest-VolumesListAdminTestJSON-685103889 None] Lock "cinder-quobyte-6bade946-c6f0-48ed-a012-9adf4c5e5869" acquired by "delete_volume" :: waited 0.041s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:32 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ce930b-8616-4094-9433-d4d51ac90df9]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7aea59e-4833-4734-a01c-ae39e542c159 tempest-VolumesListAdminTestJSON-685103889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6bade946-c6f0-48ed-a012-9adf4c5e5869 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:32 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6bade946-c6f0-48ed-a012-9adf4c5e5869 Jul 10 00:32:32 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:32 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.247s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:32 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:32:32 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:32:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 9 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:32:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:32:33 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-159cf0d4-80d5-4d28-820a-2846889490e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4c78117f-87ee-44f0-9514-4d7b678eefc7" returned: 0 in 1.192s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:33 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-159cf0d4-80d5-4d28-820a-2846889490e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Lock "cinder-quobyte-4c78117f-87ee-44f0-9514-4d7b678eefc7" released by "delete_volume" :: held 2.272s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:33 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c202bc7f-36b3-42b6-8975-98e8b55f5bd8 tempest-VolumesListAdminTestJSON-221878611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7cb361cd-bfa1-40f1-981a-da078c0efbc0" returned: 0 in 1.184s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c202bc7f-36b3-42b6-8975-98e8b55f5bd8 tempest-VolumesListAdminTestJSON-221878611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7cb361cd-bfa1-40f1-981a-da078c0efbc0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:33 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7cb361cd-bfa1-40f1-981a-da078c0efbc0 Jul 10 00:32:33 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:33 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-159cf0d4-80d5-4d28-820a-2846889490e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Created reservations ['b332d3ea-2a0d-447a-8ba3-1ce32e46c475', 'd4d3af6a-2b97-48d9-bbc5-28319be1d546', '76cab330-a36a-4ff1-a4c0-45c363960cbe', '77f965a7-bd85-4c82-aad7-3a4ab6567035'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:32:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-159cf0d4-80d5-4d28-820a-2846889490e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-159cf0d4-80d5-4d28-820a-2846889490e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-159cf0d4-80d5-4d28-820a-2846889490e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-159cf0d4-80d5-4d28-820a-2846889490e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-159cf0d4-80d5-4d28-820a-2846889490e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-159cf0d4-80d5-4d28-820a-2846889490e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:33 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:32:33 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:33 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7aea59e-4833-4734-a01c-ae39e542c159 tempest-VolumesListAdminTestJSON-685103889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6bade946-c6f0-48ed-a012-9adf4c5e5869" returned: 0 in 1.138s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7aea59e-4833-4734-a01c-ae39e542c159 tempest-VolumesListAdminTestJSON-685103889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6bade946-c6f0-48ed-a012-9adf4c5e5869 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:33 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6bade946-c6f0-48ed-a012-9adf4c5e5869 Jul 10 00:32:33 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:33 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e1add614-31d0-4a26-8e44-2a2cc12cefbc tempest-VolumesTransfersV357Test-1484971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-856c0e27-a05d-4c15-9d44-213749dcc62b" returned: 0 in 1.417s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:33 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e1add614-31d0-4a26-8e44-2a2cc12cefbc tempest-VolumesTransfersV357Test-1484971429 None] Lock "cinder-quobyte-856c0e27-a05d-4c15-9d44-213749dcc62b" released by "delete_volume" :: held 2.616s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:33 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-e1add614-31d0-4a26-8e44-2a2cc12cefbc tempest-VolumesTransfersV357Test-1484971429 None] Created reservations ['0e6192c2-83f3-4cb1-ab6e-ae68b0c23d1e', '76bde052-153f-40fd-89e4-2f16d433cd49', 'a3bb63e9-2b56-41b6-bb75-1d60b77702af', 'c3babde2-914b-4e3c-9d6b-96841c0d061f'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:32:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e1add614-31d0-4a26-8e44-2a2cc12cefbc tempest-VolumesTransfersV357Test-1484971429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e1add614-31d0-4a26-8e44-2a2cc12cefbc tempest-VolumesTransfersV357Test-1484971429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e1add614-31d0-4a26-8e44-2a2cc12cefbc tempest-VolumesTransfersV357Test-1484971429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e1add614-31d0-4a26-8e44-2a2cc12cefbc tempest-VolumesTransfersV357Test-1484971429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e1add614-31d0-4a26-8e44-2a2cc12cefbc tempest-VolumesTransfersV357Test-1484971429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e1add614-31d0-4a26-8e44-2a2cc12cefbc tempest-VolumesTransfersV357Test-1484971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:33 devstack sudo[98499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:32:33 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:34 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c202bc7f-36b3-42b6-8975-98e8b55f5bd8 tempest-VolumesListAdminTestJSON-221878611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7cb361cd-bfa1-40f1-981a-da078c0efbc0" returned: 0 in 1.137s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:34 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c202bc7f-36b3-42b6-8975-98e8b55f5bd8 tempest-VolumesListAdminTestJSON-221878611 None] Lock "cinder-quobyte-7cb361cd-bfa1-40f1-981a-da078c0efbc0" released by "delete_volume" :: held 2.405s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:34 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-159cf0d4-80d5-4d28-820a-2846889490e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.957s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:34 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-159cf0d4-80d5-4d28-820a-2846889490e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:32:34 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-159cf0d4-80d5-4d28-820a-2846889490e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Deleted volume successfully. Jul 10 00:32:34 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:34 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-c202bc7f-36b3-42b6-8975-98e8b55f5bd8 tempest-VolumesListAdminTestJSON-221878611 None] Created reservations ['1f8f9546-294b-4819-87eb-769710f9d402', 'f7ac91f8-b7b9-495a-81f4-f210970e89d0', '9a5ff0d7-1552-4357-91f4-05880bf82591', '580334ca-18f4-49f1-8197-e65cc4be09a6'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:32:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7aea59e-4833-4734-a01c-ae39e542c159 tempest-VolumesListAdminTestJSON-685103889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6bade946-c6f0-48ed-a012-9adf4c5e5869" returned: 0 in 0.907s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:34 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a7aea59e-4833-4734-a01c-ae39e542c159 tempest-VolumesListAdminTestJSON-685103889 None] Lock "cinder-quobyte-6bade946-c6f0-48ed-a012-9adf4c5e5869" released by "delete_volume" :: held 2.131s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:34 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-159cf0d4-80d5-4d28-820a-2846889490e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-649988632 None] Lock "cinder-4c78117f-87ee-44f0-9514-4d7b678eefc7-delete_volume" released by "delete_volume" :: held 3.683s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:34 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-a7aea59e-4833-4734-a01c-ae39e542c159 tempest-VolumesListAdminTestJSON-685103889 None] Created reservations ['9758958d-e284-49b0-8ffc-523018b014cc', 'd9ddcfa0-96e6-46ad-be88-ad5043edadeb', '0060f6b6-a563-42de-a30b-5151064dd7c9', 'ce0cdb78-d3c5-4619-bc6d-1014bb24038c'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:32:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c202bc7f-36b3-42b6-8975-98e8b55f5bd8 tempest-VolumesListAdminTestJSON-221878611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c202bc7f-36b3-42b6-8975-98e8b55f5bd8 tempest-VolumesListAdminTestJSON-221878611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c202bc7f-36b3-42b6-8975-98e8b55f5bd8 tempest-VolumesListAdminTestJSON-221878611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c202bc7f-36b3-42b6-8975-98e8b55f5bd8 tempest-VolumesListAdminTestJSON-221878611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c202bc7f-36b3-42b6-8975-98e8b55f5bd8 tempest-VolumesListAdminTestJSON-221878611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c202bc7f-36b3-42b6-8975-98e8b55f5bd8 tempest-VolumesListAdminTestJSON-221878611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:34 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:32:34 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a7aea59e-4833-4734-a01c-ae39e542c159 tempest-VolumesListAdminTestJSON-685103889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a7aea59e-4833-4734-a01c-ae39e542c159 tempest-VolumesListAdminTestJSON-685103889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a7aea59e-4833-4734-a01c-ae39e542c159 tempest-VolumesListAdminTestJSON-685103889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a7aea59e-4833-4734-a01c-ae39e542c159 tempest-VolumesListAdminTestJSON-685103889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a7aea59e-4833-4734-a01c-ae39e542c159 tempest-VolumesListAdminTestJSON-685103889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7aea59e-4833-4734-a01c-ae39e542c159 tempest-VolumesListAdminTestJSON-685103889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:34 devstack sudo[98506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:32:34 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:35 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e1add614-31d0-4a26-8e44-2a2cc12cefbc tempest-VolumesTransfersV357Test-1484971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.304s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-e1add614-31d0-4a26-8e44-2a2cc12cefbc tempest-VolumesTransfersV357Test-1484971429 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:32:35 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-e1add614-31d0-4a26-8e44-2a2cc12cefbc tempest-VolumesTransfersV357Test-1484971429 None] Deleted volume successfully. Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e1add614-31d0-4a26-8e44-2a2cc12cefbc tempest-VolumesTransfersV357Test-1484971429 None] Lock "cinder-856c0e27-a05d-4c15-9d44-213749dcc62b-delete_volume" released by "delete_volume" :: held 4.320s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Flow 'volume_create_manager' (0260fd76-aa82-4e91-9169-2b5bb721ef1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87168224-d0a3-45c4-8d97-86790dbdedbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87168224-d0a3-45c4-8d97-86790dbdedbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1627922196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4731a91-9ee7-49a1-98d2-f1fa5a1c3295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2f7ad4969454f9791d76c0cf01e454b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:35Z,use_quota=True,user_id='3d6d90f4350c45e2a71bcd6663286e58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abbd12eb-4e36-417d-b3e6-b4fad41d1cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abbd12eb-4e36-417d-b3e6-b4fad41d1cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd5b1126-5fd9-4169-89c1-6203c0ca0373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd5b1126-5fd9-4169-89c1-6203c0ca0373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4731a91-9ee7-49a1-98d2-f1fa5a1c3295', 'volume_name': 'volume-d4731a91-9ee7-49a1-98d2-f1fa5a1c3295', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4db0a4f-bd2b-4473-b3d5-2293e53240cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4db0a4f-bd2b-4473-b3d5-2293e53240cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb66a9f-4ed2-40f0-b986-29f525927451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:35 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Volume d4731a91-9ee7-49a1-98d2-f1fa5a1c3295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4731a91-9ee7-49a1-98d2-f1fa5a1c3295', 'volume_size': 1} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1627922196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4731a91-9ee7-49a1-98d2-f1fa5a1c3295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2f7ad4969454f9791d76c0cf01e454b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:35Z,use_quota=True,user_id='3d6d90f4350c45e2a71bcd6663286e58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Creating volume d4731a91-9ee7-49a1-98d2-f1fa5a1c3295 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:35 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:32:35 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d4731a91-9ee7-49a1-98d2-f1fa5a1c3295 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7aea59e-4833-4734-a01c-ae39e542c159 tempest-VolumesListAdminTestJSON-685103889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.874s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-a7aea59e-4833-4734-a01c-ae39e542c159 tempest-VolumesListAdminTestJSON-685103889 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:32:35 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-a7aea59e-4833-4734-a01c-ae39e542c159 tempest-VolumesListAdminTestJSON-685103889 None] Deleted volume successfully. Jul 10 00:32:35 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d4731a91-9ee7-49a1-98d2-f1fa5a1c3295 1073741824 Jul 10 00:32:35 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a7aea59e-4833-4734-a01c-ae39e542c159 tempest-VolumesListAdminTestJSON-685103889 None] Lock "cinder-6bade946-c6f0-48ed-a012-9adf4c5e5869-delete_volume" released by "delete_volume" :: held 3.509s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-955e06be-c5dd-4b6e-944a-31e5a05c168d tempest-VolumesListAdminTestJSON-685103889 None] Acquiring lock "cinder-8939b2cb-4ed3-4a96-9bdc-ca59f962305f-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-955e06be-c5dd-4b6e-944a-31e5a05c168d tempest-VolumesListAdminTestJSON-685103889 None] Lock "cinder-8939b2cb-4ed3-4a96-9bdc-ca59f962305f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-955e06be-c5dd-4b6e-944a-31e5a05c168d tempest-VolumesListAdminTestJSON-685103889 None] Acquiring lock "cinder-quobyte-8939b2cb-4ed3-4a96-9bdc-ca59f962305f" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-955e06be-c5dd-4b6e-944a-31e5a05c168d tempest-VolumesListAdminTestJSON-685103889 None] Lock "cinder-quobyte-8939b2cb-4ed3-4a96-9bdc-ca59f962305f" acquired by "delete_volume" :: waited 0.022s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7189ffb-86f5-4ba9-9e51-1d8c993ee7c9]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-955e06be-c5dd-4b6e-944a-31e5a05c168d tempest-VolumesListAdminTestJSON-685103889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8939b2cb-4ed3-4a96-9bdc-ca59f962305f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:35 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c202bc7f-36b3-42b6-8975-98e8b55f5bd8 tempest-VolumesListAdminTestJSON-221878611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.283s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-c202bc7f-36b3-42b6-8975-98e8b55f5bd8 tempest-VolumesListAdminTestJSON-221878611 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:32:35 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-c202bc7f-36b3-42b6-8975-98e8b55f5bd8 tempest-VolumesListAdminTestJSON-221878611 None] Deleted volume successfully. Jul 10 00:32:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c202bc7f-36b3-42b6-8975-98e8b55f5bd8 tempest-VolumesListAdminTestJSON-221878611 None] Lock "cinder-7cb361cd-bfa1-40f1-981a-da078c0efbc0-delete_volume" released by "delete_volume" :: held 4.135s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:35 devstack sudo[98514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8939b2cb-4ed3-4a96-9bdc-ca59f962305f Jul 10 00:32:35 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:36 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:36 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-955e06be-c5dd-4b6e-944a-31e5a05c168d tempest-VolumesListAdminTestJSON-685103889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8939b2cb-4ed3-4a96-9bdc-ca59f962305f" returned: 0 in 0.919s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-955e06be-c5dd-4b6e-944a-31e5a05c168d tempest-VolumesListAdminTestJSON-685103889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8939b2cb-4ed3-4a96-9bdc-ca59f962305f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d4731a91-9ee7-49a1-98d2-f1fa5a1c3295 1073741824" returned: 0 in 1.215s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:36 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8939b2cb-4ed3-4a96-9bdc-ca59f962305f Jul 10 00:32:36 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d4731a91-9ee7-49a1-98d2-f1fa5a1c3295 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:36 devstack sudo[98525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d4731a91-9ee7-49a1-98d2-f1fa5a1c3295 Jul 10 00:32:36 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Flow 'volume_create_manager' (58f238b9-5043-4f6d-92bc-4bc93a32aabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ef3f63-2538-4913-abda-f2c7d49f47d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ef3f63-2538-4913-abda-f2c7d49f47d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1630314543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d692cf8e-5e93-4af8-bd38-2533cae010ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ccb39367624c48aabd15fa0dd33d47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:37Z,use_quota=True,user_id='0284ce4305b44bbebc44c6a348757a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4de182a5-12ba-4936-8704-1132021a7389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4de182a5-12ba-4936-8704-1132021a7389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b061cb74-aa7f-41da-a344-8a2666e4563b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b061cb74-aa7f-41da-a344-8a2666e4563b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd692cf8e-5e93-4af8-bd38-2533cae010ad', 'volume_name': 'volume-d692cf8e-5e93-4af8-bd38-2533cae010ad', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:37 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310a4b83-704a-4b16-a9eb-3810d9cd3c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310a4b83-704a-4b16-a9eb-3810d9cd3c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f9ad58-02d3-4f75-8ef4-f987789fa103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:37 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Volume d692cf8e-5e93-4af8-bd38-2533cae010ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d692cf8e-5e93-4af8-bd38-2533cae010ad', 'volume_size': 1} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-955e06be-c5dd-4b6e-944a-31e5a05c168d tempest-VolumesListAdminTestJSON-685103889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8939b2cb-4ed3-4a96-9bdc-ca59f962305f" returned: 0 in 0.853s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-955e06be-c5dd-4b6e-944a-31e5a05c168d tempest-VolumesListAdminTestJSON-685103889 None] Lock "cinder-quobyte-8939b2cb-4ed3-4a96-9bdc-ca59f962305f" released by "delete_volume" :: held 1.813s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:37 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d4731a91-9ee7-49a1-98d2-f1fa5a1c3295" returned: 0 in 0.853s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] <== create_volume: return (2122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.124s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.058s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1630314543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d692cf8e-5e93-4af8-bd38-2533cae010ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ccb39367624c48aabd15fa0dd33d47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:37Z,use_quota=True,user_id='0284ce4305b44bbebc44c6a348757a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Creating volume d692cf8e-5e93-4af8-bd38-2533cae010ad {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:32:37 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d692cf8e-5e93-4af8-bd38-2533cae010ad 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:37 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d692cf8e-5e93-4af8-bd38-2533cae010ad 1073741824 Jul 10 00:32:37 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb66a9f-4ed2-40f0-b986-29f525927451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4731a91-9ee7-49a1-98d2-f1fa5a1c3295', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a20dcb8-3424-499b-a51d-1c8d9273ff80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-955e06be-c5dd-4b6e-944a-31e5a05c168d tempest-VolumesListAdminTestJSON-685103889 None] Created reservations ['c954bd0b-2268-44a5-a35b-aeeba3f4aff6', '1d2bf1d2-75f1-4f27-9a1b-a22469110b00', '21570531-8c5e-4572-a423-d90cc39b941e', '52d026af-7522-4e58-8f26-e55c2d2cc598'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:32:37 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Volume volume-d4731a91-9ee7-49a1-98d2-f1fa5a1c3295 (d4731a91-9ee7-49a1-98d2-f1fa5a1c3295): created successfully Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a20dcb8-3424-499b-a51d-1c8d9273ff80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Flow 'volume_create_manager' (0260fd76-aa82-4e91-9169-2b5bb721ef1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:37 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-9d0e0cc8-fa20-451a-8dc7-b39ceed0180d tempest-VolumesTransfersV357Test-2089884021 None] Created volume successfully. Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-955e06be-c5dd-4b6e-944a-31e5a05c168d tempest-VolumesListAdminTestJSON-685103889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-955e06be-c5dd-4b6e-944a-31e5a05c168d tempest-VolumesListAdminTestJSON-685103889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-955e06be-c5dd-4b6e-944a-31e5a05c168d tempest-VolumesListAdminTestJSON-685103889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-955e06be-c5dd-4b6e-944a-31e5a05c168d tempest-VolumesListAdminTestJSON-685103889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-955e06be-c5dd-4b6e-944a-31e5a05c168d tempest-VolumesListAdminTestJSON-685103889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-955e06be-c5dd-4b6e-944a-31e5a05c168d tempest-VolumesListAdminTestJSON-685103889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:37 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:32:37 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:38 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-23f9269c-1bea-4864-9f0c-cb504ee566f6 tempest-VolumesListAdminTestJSON-685103889 None] Acquiring lock "cinder-85faac95-ab56-417b-8031-ad6f8402518e-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:38 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-23f9269c-1bea-4864-9f0c-cb504ee566f6 tempest-VolumesListAdminTestJSON-685103889 None] Lock "cinder-85faac95-ab56-417b-8031-ad6f8402518e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:38 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-23f9269c-1bea-4864-9f0c-cb504ee566f6 tempest-VolumesListAdminTestJSON-685103889 None] Acquiring lock "cinder-quobyte-85faac95-ab56-417b-8031-ad6f8402518e" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:38 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-23f9269c-1bea-4864-9f0c-cb504ee566f6 tempest-VolumesListAdminTestJSON-685103889 None] Lock "cinder-quobyte-85faac95-ab56-417b-8031-ad6f8402518e" acquired by "delete_volume" :: waited 0.031s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:38 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e997264a-5716-4eaa-b99f-2dbfaf163452]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-23f9269c-1bea-4864-9f0c-cb504ee566f6 tempest-VolumesListAdminTestJSON-685103889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-85faac95-ab56-417b-8031-ad6f8402518e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:38 devstack sudo[98536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-85faac95-ab56-417b-8031-ad6f8402518e Jul 10 00:32:38 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:38 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-955e06be-c5dd-4b6e-944a-31e5a05c168d tempest-VolumesListAdminTestJSON-685103889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.953s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:38 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-955e06be-c5dd-4b6e-944a-31e5a05c168d tempest-VolumesListAdminTestJSON-685103889 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:32:38 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-955e06be-c5dd-4b6e-944a-31e5a05c168d tempest-VolumesListAdminTestJSON-685103889 None] Deleted volume successfully. Jul 10 00:32:38 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-955e06be-c5dd-4b6e-944a-31e5a05c168d tempest-VolumesListAdminTestJSON-685103889 None] Lock "cinder-8939b2cb-4ed3-4a96-9bdc-ca59f962305f-delete_volume" released by "delete_volume" :: held 3.099s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:38 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d692cf8e-5e93-4af8-bd38-2533cae010ad 1073741824" returned: 0 in 1.163s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d692cf8e-5e93-4af8-bd38-2533cae010ad {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:38 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d692cf8e-5e93-4af8-bd38-2533cae010ad Jul 10 00:32:38 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:38 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f7c7b601-150a-4a99-9aa7-0611f79889b8 tempest-VolumesTransfersV357Test-1484971429 None] Acquiring lock "cinder-d4731a91-9ee7-49a1-98d2-f1fa5a1c3295-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:38 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f7c7b601-150a-4a99-9aa7-0611f79889b8 tempest-VolumesTransfersV357Test-1484971429 None] Lock "cinder-d4731a91-9ee7-49a1-98d2-f1fa5a1c3295-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:39 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f7c7b601-150a-4a99-9aa7-0611f79889b8 tempest-VolumesTransfersV357Test-1484971429 None] Acquiring lock "cinder-quobyte-d4731a91-9ee7-49a1-98d2-f1fa5a1c3295" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:39 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f7c7b601-150a-4a99-9aa7-0611f79889b8 tempest-VolumesTransfersV357Test-1484971429 None] Lock "cinder-quobyte-d4731a91-9ee7-49a1-98d2-f1fa5a1c3295" acquired by "delete_volume" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:39 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[deddb8c3-7e51-440d-bf3f-0a67e3962279]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f7c7b601-150a-4a99-9aa7-0611f79889b8 tempest-VolumesTransfersV357Test-1484971429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d4731a91-9ee7-49a1-98d2-f1fa5a1c3295 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:39 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d4731a91-9ee7-49a1-98d2-f1fa5a1c3295 Jul 10 00:32:39 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:39 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-23f9269c-1bea-4864-9f0c-cb504ee566f6 tempest-VolumesListAdminTestJSON-685103889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-85faac95-ab56-417b-8031-ad6f8402518e" returned: 0 in 1.021s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-23f9269c-1bea-4864-9f0c-cb504ee566f6 tempest-VolumesListAdminTestJSON-685103889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-85faac95-ab56-417b-8031-ad6f8402518e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:39 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-85faac95-ab56-417b-8031-ad6f8402518e Jul 10 00:32:39 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:39 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d692cf8e-5e93-4af8-bd38-2533cae010ad" returned: 0 in 0.780s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:39 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] <== create_volume: return (1997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:32:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f9ad58-02d3-4f75-8ef4-f987789fa103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d692cf8e-5e93-4af8-bd38-2533cae010ad', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e5a004-ccae-4cbe-a3c8-ce71d6034bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:39 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Volume volume-d692cf8e-5e93-4af8-bd38-2533cae010ad (d692cf8e-5e93-4af8-bd38-2533cae010ad): created successfully Jul 10 00:32:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e5a004-ccae-4cbe-a3c8-ce71d6034bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Flow 'volume_create_manager' (58f238b9-5043-4f6d-92bc-4bc93a32aabc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:39 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-f0f8d684-1917-45fe-a650-0b04a762eaea tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Created volume successfully. Jul 10 00:32:40 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f7c7b601-150a-4a99-9aa7-0611f79889b8 tempest-VolumesTransfersV357Test-1484971429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d4731a91-9ee7-49a1-98d2-f1fa5a1c3295" returned: 0 in 0.928s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f7c7b601-150a-4a99-9aa7-0611f79889b8 tempest-VolumesTransfersV357Test-1484971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d4731a91-9ee7-49a1-98d2-f1fa5a1c3295 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:40 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d4731a91-9ee7-49a1-98d2-f1fa5a1c3295 Jul 10 00:32:40 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:40 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-23f9269c-1bea-4864-9f0c-cb504ee566f6 tempest-VolumesListAdminTestJSON-685103889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-85faac95-ab56-417b-8031-ad6f8402518e" returned: 0 in 0.783s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:40 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-23f9269c-1bea-4864-9f0c-cb504ee566f6 tempest-VolumesListAdminTestJSON-685103889 None] Lock "cinder-quobyte-85faac95-ab56-417b-8031-ad6f8402518e" released by "delete_volume" :: held 1.874s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:40 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-23f9269c-1bea-4864-9f0c-cb504ee566f6 tempest-VolumesListAdminTestJSON-685103889 None] Created reservations ['a6379603-c69a-450f-8d37-83e3b9196b0d', '2d6aa12a-59b9-4892-9e3f-04da1216ba64', 'cfb6f563-6dad-4642-8c27-3585bff0477e', '4496259b-fde0-4c7d-9c2d-a10554b91ace'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:32:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-23f9269c-1bea-4864-9f0c-cb504ee566f6 tempest-VolumesListAdminTestJSON-685103889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-23f9269c-1bea-4864-9f0c-cb504ee566f6 tempest-VolumesListAdminTestJSON-685103889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-23f9269c-1bea-4864-9f0c-cb504ee566f6 tempest-VolumesListAdminTestJSON-685103889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-23f9269c-1bea-4864-9f0c-cb504ee566f6 tempest-VolumesListAdminTestJSON-685103889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-23f9269c-1bea-4864-9f0c-cb504ee566f6 tempest-VolumesListAdminTestJSON-685103889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-23f9269c-1bea-4864-9f0c-cb504ee566f6 tempest-VolumesListAdminTestJSON-685103889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:40 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:32:40 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:40 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f7c7b601-150a-4a99-9aa7-0611f79889b8 tempest-VolumesTransfersV357Test-1484971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d4731a91-9ee7-49a1-98d2-f1fa5a1c3295" returned: 0 in 0.737s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:40 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f7c7b601-150a-4a99-9aa7-0611f79889b8 tempest-VolumesTransfersV357Test-1484971429 None] Lock "cinder-quobyte-d4731a91-9ee7-49a1-98d2-f1fa5a1c3295" released by "delete_volume" :: held 1.724s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:40 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-f7c7b601-150a-4a99-9aa7-0611f79889b8 tempest-VolumesTransfersV357Test-1484971429 None] Created reservations ['5b04ef02-1aa4-4ca7-b5a8-141346aa5c6c', '51b8d972-6e9e-4d09-8109-95e123f320f5', 'f6acf2b7-8d08-4dd2-9851-581889e703f6', 'bfbd14ed-0d51-4701-8c8a-30f3c1c23ee2'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:32:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f7c7b601-150a-4a99-9aa7-0611f79889b8 tempest-VolumesTransfersV357Test-1484971429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f7c7b601-150a-4a99-9aa7-0611f79889b8 tempest-VolumesTransfersV357Test-1484971429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:41 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f7c7b601-150a-4a99-9aa7-0611f79889b8 tempest-VolumesTransfersV357Test-1484971429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:41 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f7c7b601-150a-4a99-9aa7-0611f79889b8 tempest-VolumesTransfersV357Test-1484971429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f7c7b601-150a-4a99-9aa7-0611f79889b8 tempest-VolumesTransfersV357Test-1484971429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f7c7b601-150a-4a99-9aa7-0611f79889b8 tempest-VolumesTransfersV357Test-1484971429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:41 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:32:41 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:41 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-23f9269c-1bea-4864-9f0c-cb504ee566f6 tempest-VolumesListAdminTestJSON-685103889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.045s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:41 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-23f9269c-1bea-4864-9f0c-cb504ee566f6 tempest-VolumesListAdminTestJSON-685103889 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:32:41 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-23f9269c-1bea-4864-9f0c-cb504ee566f6 tempest-VolumesListAdminTestJSON-685103889 None] Deleted volume successfully. Jul 10 00:32:41 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-23f9269c-1bea-4864-9f0c-cb504ee566f6 tempest-VolumesListAdminTestJSON-685103889 None] Lock "cinder-85faac95-ab56-417b-8031-ad6f8402518e-delete_volume" released by "delete_volume" :: held 3.212s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:41 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f7c7b601-150a-4a99-9aa7-0611f79889b8 tempest-VolumesTransfersV357Test-1484971429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.816s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:41 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-f7c7b601-150a-4a99-9aa7-0611f79889b8 tempest-VolumesTransfersV357Test-1484971429 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:32:41 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-f7c7b601-150a-4a99-9aa7-0611f79889b8 tempest-VolumesTransfersV357Test-1484971429 None] Deleted volume successfully. Jul 10 00:32:41 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f7c7b601-150a-4a99-9aa7-0611f79889b8 tempest-VolumesTransfersV357Test-1484971429 None] Lock "cinder-d4731a91-9ee7-49a1-98d2-f1fa5a1c3295-delete_volume" released by "delete_volume" :: held 2.952s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:42 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-407ee861-c940-4d14-a036-32b91483b07c tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Acquiring lock "cinder-d692cf8e-5e93-4af8-bd38-2533cae010ad-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:42 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-407ee861-c940-4d14-a036-32b91483b07c tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Lock "cinder-d692cf8e-5e93-4af8-bd38-2533cae010ad-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:42 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-407ee861-c940-4d14-a036-32b91483b07c tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Acquiring lock "cinder-quobyte-d692cf8e-5e93-4af8-bd38-2533cae010ad" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:42 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-407ee861-c940-4d14-a036-32b91483b07c tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Lock "cinder-quobyte-d692cf8e-5e93-4af8-bd38-2533cae010ad" acquired by "delete_volume" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:42 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[77350868-3155-4cbf-9dcd-0426ae173b75]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-407ee861-c940-4d14-a036-32b91483b07c tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d692cf8e-5e93-4af8-bd38-2533cae010ad {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:42 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d692cf8e-5e93-4af8-bd38-2533cae010ad Jul 10 00:32:42 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:43 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-407ee861-c940-4d14-a036-32b91483b07c tempest-VolumeQuotasNegativeTestJSON-1083033727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d692cf8e-5e93-4af8-bd38-2533cae010ad" returned: 0 in 0.993s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-407ee861-c940-4d14-a036-32b91483b07c tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d692cf8e-5e93-4af8-bd38-2533cae010ad {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:43 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d692cf8e-5e93-4af8-bd38-2533cae010ad Jul 10 00:32:43 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:44 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-407ee861-c940-4d14-a036-32b91483b07c tempest-VolumeQuotasNegativeTestJSON-1083033727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d692cf8e-5e93-4af8-bd38-2533cae010ad" returned: 0 in 0.913s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:44 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-407ee861-c940-4d14-a036-32b91483b07c tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Lock "cinder-quobyte-d692cf8e-5e93-4af8-bd38-2533cae010ad" released by "delete_volume" :: held 1.955s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:44 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-407ee861-c940-4d14-a036-32b91483b07c tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Created reservations ['67ff1805-9451-4ff5-85be-41bb68bbc37a', '1ef171f4-78f1-4bef-8652-5b13eae21808', '2726918e-6d2f-4af6-8609-3990ac39db75', '2c51515e-5749-4d4d-ac6d-08fea54363a7'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:32:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-407ee861-c940-4d14-a036-32b91483b07c tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-407ee861-c940-4d14-a036-32b91483b07c tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-407ee861-c940-4d14-a036-32b91483b07c tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-407ee861-c940-4d14-a036-32b91483b07c tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-407ee861-c940-4d14-a036-32b91483b07c tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-407ee861-c940-4d14-a036-32b91483b07c tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:44 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:32:44 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:45 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-407ee861-c940-4d14-a036-32b91483b07c tempest-VolumeQuotasNegativeTestJSON-1083033727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.234s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:45 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-407ee861-c940-4d14-a036-32b91483b07c tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:32:45 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-407ee861-c940-4d14-a036-32b91483b07c tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Deleted volume successfully. Jul 10 00:32:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-407ee861-c940-4d14-a036-32b91483b07c tempest-VolumeQuotasNegativeTestJSON-1083033727 None] Lock "cinder-d692cf8e-5e93-4af8-bd38-2533cae010ad-delete_volume" released by "delete_volume" :: held 3.535s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:32:48 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:32:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Flow 'volume_create_manager' (a1bafbbc-d7df-41a9-ad3a-543266d1971a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e4c05c-ea5e-4183-ad1e-16290bc232b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e4c05c-ea5e-4183-ad1e-16290bc232b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1615661405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6d664f1-3a0d-4fcb-afb9-c2214536957c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a8df430670b48b1aa4301487e36ce81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:48Z,use_quota=True,user_id='2a13453b511e49e68458f1b0a8082125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e22cf176-76a2-474a-8b51-b56892889bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e22cf176-76a2-474a-8b51-b56892889bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5039ebb3-3733-453f-ac41-da6beefd09a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5039ebb3-3733-453f-ac41-da6beefd09a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6d664f1-3a0d-4fcb-afb9-c2214536957c', 'volume_name': 'volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e9c910a-9573-4c56-ae2d-617bde5b5ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e9c910a-9573-4c56-ae2d-617bde5b5ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47579f3f-db16-4738-8bb4-737a4ec5e661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:48 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Volume b6d664f1-3a0d-4fcb-afb9-c2214536957c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c', 'volume_size': 1} Jul 10 00:32:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1615661405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6d664f1-3a0d-4fcb-afb9-c2214536957c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a8df430670b48b1aa4301487e36ce81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:48Z,use_quota=True,user_id='2a13453b511e49e68458f1b0a8082125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:32:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Creating volume b6d664f1-3a0d-4fcb-afb9-c2214536957c {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:32:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:32:48 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:32:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:48 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c 1073741824 Jul 10 00:32:48 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:49 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c 1073741824" returned: 0 in 1.094s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:49 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c Jul 10 00:32:49 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:49 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:32:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Flow 'volume_create_manager' (60112669-b452-49e2-b2a0-47a0a1d3c37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a25bf88-f236-457b-bbeb-1e94e495af14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a25bf88-f236-457b-bbeb-1e94e495af14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2110498601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b11338-b78c-4adc-83cb-c880d1210778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7116815b6074afe8a1c5655c45c0b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:50Z,use_quota=True,user_id='0d1a4b1216f8465a829ac6e122bc7059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb5ff28-8bfa-4f8e-88a5-084f0a6c4b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb5ff28-8bfa-4f8e-88a5-084f0a6c4b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ab7b52-0dca-4a14-9db2-a2311dca8ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ab7b52-0dca-4a14-9db2-a2311dca8ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57b11338-b78c-4adc-83cb-c880d1210778', 'volume_name': 'volume-57b11338-b78c-4adc-83cb-c880d1210778', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b918e6d-2f34-491a-b170-c250362b0b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b918e6d-2f34-491a-b170-c250362b0b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f10261-678b-48aa-b52e-5ff024d14fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:49 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Volume 57b11338-b78c-4adc-83cb-c880d1210778: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57b11338-b78c-4adc-83cb-c880d1210778', 'volume_size': 1} Jul 10 00:32:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:50 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c" returned: 0 in 0.816s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] <== create_volume: return (1975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:32:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.978s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.302s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2110498601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b11338-b78c-4adc-83cb-c880d1210778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7116815b6074afe8a1c5655c45c0b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:50Z,use_quota=True,user_id='0d1a4b1216f8465a829ac6e122bc7059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:32:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Creating volume 57b11338-b78c-4adc-83cb-c880d1210778 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:32:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:32:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:32:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:32:50 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:32:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:50 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778 1073741824 Jul 10 00:32:50 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47579f3f-db16-4738-8bb4-737a4ec5e661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce7aa84-90fd-4c7f-819b-5b00497122e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:50 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Volume volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c (b6d664f1-3a0d-4fcb-afb9-c2214536957c): created successfully Jul 10 00:32:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce7aa84-90fd-4c7f-819b-5b00497122e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Flow 'volume_create_manager' (a1bafbbc-d7df-41a9-ad3a-543266d1971a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:50 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-890996da-3440-444a-b220-a17563ca555f tempest-SnapshotMetadataTestJSON-1952210833 None] Created volume successfully. Jul 10 00:32:51 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778 1073741824" returned: 0 in 0.902s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:51 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778 Jul 10 00:32:51 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-08e23fb5-705c-4de9-9df5-afd28f78af3d tempest-SnapshotMetadataTestJSON-1952210833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:51 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778" returned: 0 in 0.852s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:32:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-08e23fb5-705c-4de9-9df5-afd28f78af3d tempest-SnapshotMetadataTestJSON-1952210833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.549s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:52 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-08e23fb5-705c-4de9-9df5-afd28f78af3d tempest-SnapshotMetadataTestJSON-1952210833 None] Creating offline snapshot f65f09d5-660c-4bd7-86d5-930b4e3ae758 of volume b6d664f1-3a0d-4fcb-afb9-c2214536957c {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:32:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f10261-678b-48aa-b52e-5ff024d14fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57b11338-b78c-4adc-83cb-c880d1210778', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a99d997-ee12-4b0c-ac06-73d7000ac756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:52 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7723b0-8a01-46d4-b4fe-0f119ea0e032]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08e23fb5-705c-4de9-9df5-afd28f78af3d tempest-SnapshotMetadataTestJSON-1952210833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:52 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Volume volume-57b11338-b78c-4adc-83cb-c880d1210778 (57b11338-b78c-4adc-83cb-c880d1210778): created successfully Jul 10 00:32:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a99d997-ee12-4b0c-ac06-73d7000ac756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Flow 'volume_create_manager' (60112669-b452-49e2-b2a0-47a0a1d3c37b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:52 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:32:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Flow 'volume_create_manager' (c4417261-3acb-4560-adb6-f1a6fb87a55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d625ca99-935a-4c66-972b-1f01ec658806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:52 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-ee1ea113-c7ae-4cde-8293-9856d6dda354 tempest-VolumesCloneTest-63569726 None] Created volume successfully. Jul 10 00:32:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d625ca99-935a-4c66-972b-1f01ec658806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1877713129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8ddab69-9d3b-400f-9baa-81fdf13f06bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60df7a5278d94a1fab2a5de5f8d316ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:52Z,use_quota=True,user_id='859a741dbf934adabf9a19ea5ec04a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9aa81e-1563-4e53-b782-e931a9239346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9aa81e-1563-4e53-b782-e931a9239346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (418835f0-178c-48cf-93aa-9cb24a99621e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:52 devstack cinder-volume[88119]: DEBUG cinder.image.glance [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Creating Keystone auth plugin from conf {{(pid=88119) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 00:32:52 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c Jul 10 00:32:52 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:53 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08e23fb5-705c-4de9-9df5-afd28f78af3d tempest-SnapshotMetadataTestJSON-1952210833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c" returned: 0 in 1.008s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08e23fb5-705c-4de9-9df5-afd28f78af3d tempest-SnapshotMetadataTestJSON-1952210833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.f65f09d5-660c-4bd7-86d5-930b4e3ae758 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:53 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.f65f09d5-660c-4bd7-86d5-930b4e3ae758 1G Jul 10 00:32:53 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (418835f0-178c-48cf-93aa-9cb24a99621e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f8ddab69-9d3b-400f-9baa-81fdf13f06bf', 'volume_name': 'volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf', 'volume_size': 1, 'image_id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a6d0c978-002e-4d46-ab92-a0880bff49c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9bf3eaae61a647cbbfcb8c7cdd60fe87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'created_at': datetime.datetime(2026, 7, 9, 22, 17, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 17, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a6d0c978-002e-4d46-ab92-a0880bff49c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (781978d5-c040-4cb6-a84c-4659c32ab3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (781978d5-c040-4cb6-a84c-4659c32ab3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6258ef08-8b95-4299-9638-7c3e0de969ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:53 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Volume f8ddab69-9d3b-400f-9baa-81fdf13f06bf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf', 'volume_size': 1, 'image_id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a6d0c978-002e-4d46-ab92-a0880bff49c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9bf3eaae61a647cbbfcb8c7cdd60fe87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'created_at': datetime.datetime(2026, 7, 9, 22, 17, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 17, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a6d0c978-002e-4d46-ab92-a0880bff49c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 00:32:53 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Trying to clone f8ddab69-9d3b-400f-9baa-81fdf13f06bf from image a6d0c978-002e-4d46-ab92-a0880bff49c1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a6d0c978-002e-4d46-ab92-a0880bff49c1', 'metadata': {}}]). {{(pid=88119) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 00:32:53 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:32:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Flow 'volume_create_manager' (e8376862-dfa1-4bf0-8773-4a32f253827f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:32:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f82041-6e81-4021-83df-3a9f7e1c3d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f82041-6e81-4021-83df-3a9f7e1c3d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1744575315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7116815b6074afe8a1c5655c45c0b77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=57b11338-b78c-4adc-83cb-c880d1210778,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:54Z,use_quota=True,user_id='0d1a4b1216f8465a829ac6e122bc7059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ed87df-a674-415e-bbc7-3886c48a11c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ed87df-a674-415e-bbc7-3886c48a11c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c7bb7d8-d479-4608-9227-dc0ecf205227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:53 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_q2d9q3dpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 00:32:53 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Image download 20.69 MB at 20.69 MB/s Jul 10 00:32:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c7bb7d8-d479-4608-9227-dc0ecf205227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5', 'volume_name': 'volume-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5', 'volume_size': 2, 'source_volid': '57b11338-b78c-4adc-83cb-c880d1210778', 'source_volstatus': 'available'}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9018f22-17da-434f-a1db-6028bb17c7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9018f22-17da-434f-a1db-6028bb17c7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:32:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02aacfc1-7db2-40c4-a39d-bb33c5a37ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:32:53 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Volume 94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5', 'volume_size': 2, 'source_volid': '57b11338-b78c-4adc-83cb-c880d1210778', 'source_volstatus': 'available'} Jul 10 00:32:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:53 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a76ebc5-9b8d-4e1e-99b9-be2c5e5e3f1a]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_q2d9q3dpdevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:54 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_q2d9q3dpdevstack@QuobyteHD Jul 10 00:32:54 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:54 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08e23fb5-705c-4de9-9df5-afd28f78af3d tempest-SnapshotMetadataTestJSON-1952210833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.f65f09d5-660c-4bd7-86d5-930b4e3ae758 1G" returned: 0 in 1.147s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08e23fb5-705c-4de9-9df5-afd28f78af3d tempest-SnapshotMetadataTestJSON-1952210833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.f65f09d5-660c-4bd7-86d5-930b4e3ae758 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:54 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.f65f09d5-660c-4bd7-86d5-930b4e3ae758 Jul 10 00:32:54 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:54 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_q2d9q3dpdevstack@QuobyteHD" returned: 0 in 0.889s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:54 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Temporary image a6d0c978-002e-4d46-ab92-a0880bff49c1 is fetched for user 859a741dbf934adabf9a19ea5ec04a05. {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 00:32:54 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5901ba77-b9d1-4f45-b90f-13c68a7dabef]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_q2d9q3dpdevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:54 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08e23fb5-705c-4de9-9df5-afd28f78af3d tempest-SnapshotMetadataTestJSON-1952210833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.f65f09d5-660c-4bd7-86d5-930b4e3ae758" returned: 0 in 0.756s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:54 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-08e23fb5-705c-4de9-9df5-afd28f78af3d tempest-SnapshotMetadataTestJSON-1952210833 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.f65f09d5-660c-4bd7-86d5-930b4e3ae758 is being set with open permissions: ugo+rw Jul 10 00:32:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08e23fb5-705c-4de9-9df5-afd28f78af3d tempest-SnapshotMetadataTestJSON-1952210833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.f65f09d5-660c-4bd7-86d5-930b4e3ae758 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:54 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_q2d9q3dpdevstack@QuobyteHD Jul 10 00:32:54 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:55 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.f65f09d5-660c-4bd7-86d5-930b4e3ae758 Jul 10 00:32:55 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:55 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_q2d9q3dpdevstack@QuobyteHD" returned: 0 in 0.774s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:32:55 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08e23fb5-705c-4de9-9df5-afd28f78af3d tempest-SnapshotMetadataTestJSON-1952210833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.f65f09d5-660c-4bd7-86d5-930b4e3ae758" returned: 0 in 0.767s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08e23fb5-705c-4de9-9df5-afd28f78af3d tempest-SnapshotMetadataTestJSON-1952210833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:55 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.info Jul 10 00:32:55 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:56 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08e23fb5-705c-4de9-9df5-afd28f78af3d tempest-SnapshotMetadataTestJSON-1952210833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.info" returned: 0 in 0.708s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:56 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-08e23fb5-705c-4de9-9df5-afd28f78af3d tempest-SnapshotMetadataTestJSON-1952210833 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.info is being set with open permissions: ugo+rw Jul 10 00:32:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08e23fb5-705c-4de9-9df5-afd28f78af3d tempest-SnapshotMetadataTestJSON-1952210833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:56 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.info Jul 10 00:32:56 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:57 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08e23fb5-705c-4de9-9df5-afd28f78af3d tempest-SnapshotMetadataTestJSON-1952210833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.info" returned: 0 in 0.753s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-08e23fb5-705c-4de9-9df5-afd28f78af3d tempest-SnapshotMetadataTestJSON-1952210833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.259s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:32:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.409s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:32:57 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Cloning volume 57b11338-b78c-4adc-83cb-c880d1210778 to volume 94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5 Jul 10 00:32:57 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-08e23fb5-705c-4de9-9df5-afd28f78af3d tempest-SnapshotMetadataTestJSON-1952210833 None] Create snapshot completed successfully Jul 10 00:32:57 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Creating offline snapshot ce19dd16-6a9e-49be-a5b3-90d44ed4742e of volume 57b11338-b78c-4adc-83cb-c880d1210778 {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:32:57 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a683f1c-52d4-4ff8-8b07-a918029a921c]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:57 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778 Jul 10 00:32:57 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:58 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778" returned: 0 in 0.855s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.ce19dd16-6a9e-49be-a5b3-90d44ed4742e 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:58 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.ce19dd16-6a9e-49be-a5b3-90d44ed4742e 1G Jul 10 00:32:58 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:58 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b0478f73-2b26-4130-88a2-84b74da3d71f tempest-SnapshotMetadataTestJSON-1952210833 None] Acquiring lock "cinder-f65f09d5-660c-4bd7-86d5-930b4e3ae758-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:58 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b0478f73-2b26-4130-88a2-84b74da3d71f tempest-SnapshotMetadataTestJSON-1952210833 None] Lock "cinder-f65f09d5-660c-4bd7-86d5-930b4e3ae758-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:58 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b0478f73-2b26-4130-88a2-84b74da3d71f tempest-SnapshotMetadataTestJSON-1952210833 None] Acquiring lock "cinder-quobyte-b6d664f1-3a0d-4fcb-afb9-c2214536957c" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:58 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b0478f73-2b26-4130-88a2-84b74da3d71f tempest-SnapshotMetadataTestJSON-1952210833 None] Lock "cinder-quobyte-b6d664f1-3a0d-4fcb-afb9-c2214536957c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:58 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b0478f73-2b26-4130-88a2-84b74da3d71f tempest-SnapshotMetadataTestJSON-1952210833 None] Acquiring lock "cinder-quobyte-f65f09d5-660c-4bd7-86d5-930b4e3ae758" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:32:58 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b0478f73-2b26-4130-88a2-84b74da3d71f tempest-SnapshotMetadataTestJSON-1952210833 None] Lock "cinder-quobyte-f65f09d5-660c-4bd7-86d5-930b4e3ae758" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:32:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-b0478f73-2b26-4130-88a2-84b74da3d71f tempest-SnapshotMetadataTestJSON-1952210833 None] Deleting offline snapshot f65f09d5-660c-4bd7-86d5-930b4e3ae758 of volume b6d664f1-3a0d-4fcb-afb9-c2214536957c {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:32:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-b0478f73-2b26-4130-88a2-84b74da3d71f tempest-SnapshotMetadataTestJSON-1952210833 None] snapshot_file for this snap is: volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.f65f09d5-660c-4bd7-86d5-930b4e3ae758 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:32:58 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a62f6e6-b7b0-4c82-b5c3-eda49e6fa50c]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b0478f73-2b26-4130-88a2-84b74da3d71f tempest-SnapshotMetadataTestJSON-1952210833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.f65f09d5-660c-4bd7-86d5-930b4e3ae758 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:58 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.f65f09d5-660c-4bd7-86d5-930b4e3ae758 Jul 10 00:32:58 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:59 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.ce19dd16-6a9e-49be-a5b3-90d44ed4742e 1G" returned: 0 in 0.979s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57b11338-b78c-4adc-83cb-c880d1210778 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.ce19dd16-6a9e-49be-a5b3-90d44ed4742e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:59 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57b11338-b78c-4adc-83cb-c880d1210778 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.ce19dd16-6a9e-49be-a5b3-90d44ed4742e Jul 10 00:32:59 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:32:59 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Jul 10 00:32:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b0478f73-2b26-4130-88a2-84b74da3d71f tempest-SnapshotMetadataTestJSON-1952210833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.f65f09d5-660c-4bd7-86d5-930b4e3ae758" returned: 0 in 0.878s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:32:59 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-b0478f73-2b26-4130-88a2-84b74da3d71f tempest-SnapshotMetadataTestJSON-1952210833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:32:59 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e183b1-aa8d-4561-b82f-e3962224a733]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:32:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b0478f73-2b26-4130-88a2-84b74da3d71f tempest-SnapshotMetadataTestJSON-1952210833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:32:59 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c Jul 10 00:32:59 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:00 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57b11338-b78c-4adc-83cb-c880d1210778 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.ce19dd16-6a9e-49be-a5b3-90d44ed4742e" returned: 0 in 0.811s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:00 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.ce19dd16-6a9e-49be-a5b3-90d44ed4742e is being set with open permissions: ugo+rw Jul 10 00:33:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.ce19dd16-6a9e-49be-a5b3-90d44ed4742e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:00 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.ce19dd16-6a9e-49be-a5b3-90d44ed4742e Jul 10 00:33:00 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:00 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b0478f73-2b26-4130-88a2-84b74da3d71f tempest-SnapshotMetadataTestJSON-1952210833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c" returned: 0 in 1.025s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b0478f73-2b26-4130-88a2-84b74da3d71f tempest-SnapshotMetadataTestJSON-1952210833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.f65f09d5-660c-4bd7-86d5-930b4e3ae758 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:00 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.f65f09d5-660c-4bd7-86d5-930b4e3ae758 Jul 10 00:33:00 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:00 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.ce19dd16-6a9e-49be-a5b3-90d44ed4742e" returned: 0 in 0.715s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:00 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.info Jul 10 00:33:00 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:01 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.info" returned: 0 in 0.692s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:01 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.info is being set with open permissions: ugo+rw Jul 10 00:33:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:01 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.info Jul 10 00:33:01 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:01 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b0478f73-2b26-4130-88a2-84b74da3d71f tempest-SnapshotMetadataTestJSON-1952210833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.f65f09d5-660c-4bd7-86d5-930b4e3ae758" returned: 0 in 0.851s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b0478f73-2b26-4130-88a2-84b74da3d71f tempest-SnapshotMetadataTestJSON-1952210833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.f65f09d5-660c-4bd7-86d5-930b4e3ae758 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:01 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.f65f09d5-660c-4bd7-86d5-930b4e3ae758 Jul 10 00:33:01 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:02 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.info" returned: 0 in 0.745s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Acquiring lock "cinder-quobyte-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5" by "_copy_volume_from_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Lock "cinder-quobyte-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] snapshot: ce19dd16-6a9e-49be-a5b3-90d44ed4742e, volume: 94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5, {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 00:33:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:02 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:02 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d251b70-0c95-4e7f-bf28-5187a15bdc29]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.ce19dd16-6a9e-49be-a5b3-90d44ed4742e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b0478f73-2b26-4130-88a2-84b74da3d71f tempest-SnapshotMetadataTestJSON-1952210833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c.f65f09d5-660c-4bd7-86d5-930b4e3ae758" returned: 0 in 0.797s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b0478f73-2b26-4130-88a2-84b74da3d71f tempest-SnapshotMetadataTestJSON-1952210833 None] Lock "cinder-quobyte-f65f09d5-660c-4bd7-86d5-930b4e3ae758" released by "_delete_snapshot" :: held 3.681s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b0478f73-2b26-4130-88a2-84b74da3d71f tempest-SnapshotMetadataTestJSON-1952210833 None] Lock "cinder-quobyte-b6d664f1-3a0d-4fcb-afb9-c2214536957c" released by "delete_snapshot" :: held 3.705s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:02 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.ce19dd16-6a9e-49be-a5b3-90d44ed4742e Jul 10 00:33:02 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:02 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-b0478f73-2b26-4130-88a2-84b74da3d71f tempest-SnapshotMetadataTestJSON-1952210833 None] Created reservations ['0409d7bc-7529-46f8-9696-f4713a90f64e', '0c47bcd7-5ee0-4769-b88d-20b1b5085f64', '26382b43-bc71-48ee-ab59-a655efa8da9c', '191aac26-acec-4e81-ade1-11a1c4d00f75'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:33:02 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-b0478f73-2b26-4130-88a2-84b74da3d71f tempest-SnapshotMetadataTestJSON-1952210833 None] Delete snapshot completed successfully. Jul 10 00:33:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b0478f73-2b26-4130-88a2-84b74da3d71f tempest-SnapshotMetadataTestJSON-1952210833 None] Lock "cinder-f65f09d5-660c-4bd7-86d5-930b4e3ae758-delete_snapshot" released by "delete_snapshot" :: held 3.868s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:03 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-539663b2-8057-4138-9913-b73f18daeff6 tempest-SnapshotMetadataTestJSON-1952210833 None] Acquiring lock "cinder-b6d664f1-3a0d-4fcb-afb9-c2214536957c-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:03 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-539663b2-8057-4138-9913-b73f18daeff6 tempest-SnapshotMetadataTestJSON-1952210833 None] Lock "cinder-b6d664f1-3a0d-4fcb-afb9-c2214536957c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:03 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-539663b2-8057-4138-9913-b73f18daeff6 tempest-SnapshotMetadataTestJSON-1952210833 None] Acquiring lock "cinder-quobyte-b6d664f1-3a0d-4fcb-afb9-c2214536957c" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:03 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-539663b2-8057-4138-9913-b73f18daeff6 tempest-SnapshotMetadataTestJSON-1952210833 None] Lock "cinder-quobyte-b6d664f1-3a0d-4fcb-afb9-c2214536957c" acquired by "delete_volume" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:03 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c3ed78-e8fa-4ab7-8bd2-81932ba61f97]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-539663b2-8057-4138-9913-b73f18daeff6 tempest-SnapshotMetadataTestJSON-1952210833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:03 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.ce19dd16-6a9e-49be-a5b3-90d44ed4742e" returned: 0 in 0.909s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57b11338-b78c-4adc-83cb-c880d1210778(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:33:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778 {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 00:33:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Creating direct copy from snapshot {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 00:33:03 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[078c4a5f-ca0a-4c4a-baa1-7ce7294754ed]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:03 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c Jul 10 00:33:03 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:03 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778 Jul 10 00:33:03 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:03 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-539663b2-8057-4138-9913-b73f18daeff6 tempest-SnapshotMetadataTestJSON-1952210833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c" returned: 0 in 0.865s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-539663b2-8057-4138-9913-b73f18daeff6 tempest-SnapshotMetadataTestJSON-1952210833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:04 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c Jul 10 00:33:04 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:04 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778" returned: 0 in 0.916s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:04 devstack cinder-volume[88119]: DEBUG cinder.utils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Path /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5 not found in is_blk_device check {{(pid=88119) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 00:33:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:04 devstack sudo[98722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5 Jul 10 00:33:04 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:04 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-539663b2-8057-4138-9913-b73f18daeff6 tempest-SnapshotMetadataTestJSON-1952210833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b6d664f1-3a0d-4fcb-afb9-c2214536957c" returned: 0 in 0.708s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-539663b2-8057-4138-9913-b73f18daeff6 tempest-SnapshotMetadataTestJSON-1952210833 None] Lock "cinder-quobyte-b6d664f1-3a0d-4fcb-afb9-c2214536957c" released by "delete_volume" :: held 1.636s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:04 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-539663b2-8057-4138-9913-b73f18daeff6 tempest-SnapshotMetadataTestJSON-1952210833 None] Created reservations ['6bb36e7a-64d6-410d-8524-9df7db78d2e8', '8c53181e-9264-4c7c-a06c-5e81c63e6486', '4d1a5a98-d80a-459e-8816-2c1b09d17282', 'd8170ee9-014c-4bc4-994c-26b4d6200ead'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:33:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-539663b2-8057-4138-9913-b73f18daeff6 tempest-SnapshotMetadataTestJSON-1952210833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-539663b2-8057-4138-9913-b73f18daeff6 tempest-SnapshotMetadataTestJSON-1952210833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:04 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-539663b2-8057-4138-9913-b73f18daeff6 tempest-SnapshotMetadataTestJSON-1952210833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:04 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-539663b2-8057-4138-9913-b73f18daeff6 tempest-SnapshotMetadataTestJSON-1952210833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-539663b2-8057-4138-9913-b73f18daeff6 tempest-SnapshotMetadataTestJSON-1952210833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-539663b2-8057-4138-9913-b73f18daeff6 tempest-SnapshotMetadataTestJSON-1952210833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:04 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:33:04 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:06 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-539663b2-8057-4138-9913-b73f18daeff6 tempest-SnapshotMetadataTestJSON-1952210833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.752s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:06 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-539663b2-8057-4138-9913-b73f18daeff6 tempest-SnapshotMetadataTestJSON-1952210833 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:33:06 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-539663b2-8057-4138-9913-b73f18daeff6 tempest-SnapshotMetadataTestJSON-1952210833 None] Deleted volume successfully. Jul 10 00:33:06 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-539663b2-8057-4138-9913-b73f18daeff6 tempest-SnapshotMetadataTestJSON-1952210833 None] Lock "cinder-b6d664f1-3a0d-4fcb-afb9-c2214536957c-delete_volume" released by "delete_volume" :: held 3.714s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:10 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5" returned: 0 in 6.025s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:10 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e98dbd2-b33f-4adb-92bb-dff8d68d93f7]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:10 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778 Jul 10 00:33:10 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:11 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778" returned: 0 in 1.111s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:11 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Image conversion details: src /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778, size 1024.00 MB, duration 6.03 sec, destination /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5 {{(pid=88119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:33:11 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Converted 1024.00 MB image at 169.93 MB/s Jul 10 00:33:11 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5 is being set with open permissions: ugo+rw Jul 10 00:33:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:11 devstack sudo[98746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5 Jul 10 00:33:11 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:11 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=119,cinder:UPDATE=158,cinder:INSERT=40,cinder:DELETE=7 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:33:11 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=117,cinder:UPDATE=157,cinder:INSERT=37,cinder:DELETE=17 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:33:11 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:33:11 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Flow 'volume_create_manager' (6878841d-9967-487f-b9c0-9dddb8ff5e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:33:11 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65341e1-ec94-423a-8d9b-49084d780038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65341e1-ec94-423a-8d9b-49084d780038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-736561847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='317bff527d454a2c881abc579c4e044e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:33:12Z,use_quota=True,user_id='9e2033287ea24303aa4bb9686c617d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (301f509f-ce28-444e-a87b-4d3ef9c18573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (301f509f-ce28-444e-a87b-4d3ef9c18573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9275df8-52be-4213-ba12-cfe5a1613add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9275df8-52be-4213-ba12-cfe5a1613add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d', 'volume_name': 'volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d419c40-7614-4a61-826c-ff9a095d9bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d419c40-7614-4a61-826c-ff9a095d9bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d0e55d-7c2f-4e10-a1fb-88c526cbb606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:12 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Volume fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d', 'volume_size': 1} Jul 10 00:33:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:12 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5" returned: 0 in 0.839s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:12 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Lock "cinder-quobyte-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5" released by "_copy_volume_from_snapshot" :: held 9.932s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:12 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Acquiring lock "cinder-quobyte-ce19dd16-6a9e-49be-a5b3-90d44ed4742e" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:12 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Lock "cinder-quobyte-ce19dd16-6a9e-49be-a5b3-90d44ed4742e" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:12 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Deleting offline snapshot ce19dd16-6a9e-49be-a5b3-90d44ed4742e of volume 57b11338-b78c-4adc-83cb-c880d1210778 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:33:12 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] snapshot_file for this snap is: volume-57b11338-b78c-4adc-83cb-c880d1210778.ce19dd16-6a9e-49be-a5b3-90d44ed4742e {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:33:12 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[3833d05f-3692-47b8-8a9c-824845013115]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.ce19dd16-6a9e-49be-a5b3-90d44ed4742e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:12 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.ce19dd16-6a9e-49be-a5b3-90d44ed4742e Jul 10 00:33:12 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:13 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.ce19dd16-6a9e-49be-a5b3-90d44ed4742e" returned: 0 in 0.832s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57b11338-b78c-4adc-83cb-c880d1210778(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:33:13 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad4c5a7-f08f-475e-99e5-a38a6c8bb20b]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:13 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778 Jul 10 00:33:13 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:13 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778" returned: 0 in 0.769s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.ce19dd16-6a9e-49be-a5b3-90d44ed4742e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:13 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.ce19dd16-6a9e-49be-a5b3-90d44ed4742e Jul 10 00:33:13 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:14 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.ce19dd16-6a9e-49be-a5b3-90d44ed4742e" returned: 0 in 0.744s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.ce19dd16-6a9e-49be-a5b3-90d44ed4742e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:14 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.ce19dd16-6a9e-49be-a5b3-90d44ed4742e Jul 10 00:33:14 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:15 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778.ce19dd16-6a9e-49be-a5b3-90d44ed4742e" returned: 0 in 0.698s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Lock "cinder-quobyte-ce19dd16-6a9e-49be-a5b3-90d44ed4742e" released by "_delete_snapshot" :: held 3.146s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.158s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.786s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:15 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1877713129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8ddab69-9d3b-400f-9baa-81fdf13f06bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60df7a5278d94a1fab2a5de5f8d316ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:32:52Z,use_quota=True,user_id='859a741dbf934adabf9a19ea5ec04a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:33:15 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Creating volume f8ddab69-9d3b-400f-9baa-81fdf13f06bf {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:33:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:15 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:15 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:15 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:33:15 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:33:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:15 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02aacfc1-7db2-40c4-a39d-bb33c5a37ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5', 'volume_size': 2, 'source_volid': '57b11338-b78c-4adc-83cb-c880d1210778', 'source_volstatus': 'available'}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:15 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf 1073741824 Jul 10 00:33:15 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:15 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05617f1a-ddfc-483a-a1fa-1a20ef182b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:15 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Volume volume-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5 (94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5): created successfully Jul 10 00:33:15 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05617f1a-ddfc-483a-a1fa-1a20ef182b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:15 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Flow 'volume_create_manager' (e8376862-dfa1-4bf0-8773-4a32f253827f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:33:15 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-ca9c08ca-2c88-4883-a456-f9a3f93bc81f tempest-VolumesCloneTest-63569726 None] Created volume successfully. Jul 10 00:33:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a1c23e48-98a0-47fa-82b1-bf4052e8200a tempest-VolumesCloneTest-63569726 None] Acquiring lock "cinder-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a1c23e48-98a0-47fa-82b1-bf4052e8200a tempest-VolumesCloneTest-63569726 None] Lock "cinder-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a1c23e48-98a0-47fa-82b1-bf4052e8200a tempest-VolumesCloneTest-63569726 None] Acquiring lock "cinder-quobyte-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a1c23e48-98a0-47fa-82b1-bf4052e8200a tempest-VolumesCloneTest-63569726 None] Lock "cinder-quobyte-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5" acquired by "delete_volume" :: waited 0.023s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:15 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[684c7d49-5165-41ad-bd9d-67e7905ff853]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a1c23e48-98a0-47fa-82b1-bf4052e8200a tempest-VolumesCloneTest-63569726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:16 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5 Jul 10 00:33:16 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:16 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf 1073741824" returned: 0 in 1.140s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:16 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf Jul 10 00:33:16 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:16 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a1c23e48-98a0-47fa-82b1-bf4052e8200a tempest-VolumesCloneTest-63569726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5" returned: 0 in 0.922s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a1c23e48-98a0-47fa-82b1-bf4052e8200a tempest-VolumesCloneTest-63569726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:16 devstack sudo[98782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5 Jul 10 00:33:16 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Flow 'volume_create_manager' (33d5c680-d0e9-441c-ad55-cdba29c1f36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c2a51ea-b43f-4823-b10a-9ebb3fc5c189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c2a51ea-b43f-4823-b10a-9ebb3fc5c189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2111274043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2142ba4f-b5a1-47aa-b103-d0a3c0f87379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a27e82cdaeb400cbc1dc5423ebb04a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:33:17Z,use_quota=True,user_id='91a89fc2310445f789b9cd98c4058f18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (032ee187-db0c-4ca6-843b-b7dd2f2a8707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (032ee187-db0c-4ca6-843b-b7dd2f2a8707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b70393-c076-420e-9860-b9bba875ab5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b70393-c076-420e-9860-b9bba875ab5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2142ba4f-b5a1-47aa-b103-d0a3c0f87379', 'volume_name': 'volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf1c9a8-192e-4a88-84aa-cfcd0e334a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf1c9a8-192e-4a88-84aa-cfcd0e334a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020f3020-6525-4d18-8f9d-c79617903ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:17 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Volume 2142ba4f-b5a1-47aa-b103-d0a3c0f87379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379', 'volume_size': 1} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:17 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf" returned: 0 in 0.762s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] <== create_volume: return (1952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.955s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.326s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-736561847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='317bff527d454a2c881abc579c4e044e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:33:12Z,use_quota=True,user_id='9e2033287ea24303aa4bb9686c617d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Creating volume fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:33:17 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:17 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d 1073741824 Jul 10 00:33:17 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Attempting download of a6d0c978-002e-4d46-ab92-a0880bff49c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/a6d0c978-002e-4d46-ab92-a0880bff49c1', 'metadata': {}}])) to volume f8ddab69-9d3b-400f-9baa-81fdf13f06bf. {{(pid=88119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d458b10-37a4-4941-8e57-d5fb8e5f3dd5]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_79n8p91f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:17 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_79n8p91f Jul 10 00:33:17 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:17 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a1c23e48-98a0-47fa-82b1-bf4052e8200a tempest-VolumesCloneTest-63569726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5" returned: 0 in 0.762s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a1c23e48-98a0-47fa-82b1-bf4052e8200a tempest-VolumesCloneTest-63569726 None] Lock "cinder-quobyte-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5" released by "delete_volume" :: held 1.733s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-a1c23e48-98a0-47fa-82b1-bf4052e8200a tempest-VolumesCloneTest-63569726 None] Created reservations ['eef11660-7747-49d6-b4a4-e7242833f5d2', '3177d050-08a1-4914-a957-4a2fadb3c67d', '24928a2c-4437-4fe1-8c3a-fbc13c362a36', 'c0eadc35-1c74-4e7e-86c8-0e517de2d413'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a1c23e48-98a0-47fa-82b1-bf4052e8200a tempest-VolumesCloneTest-63569726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a1c23e48-98a0-47fa-82b1-bf4052e8200a tempest-VolumesCloneTest-63569726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a1c23e48-98a0-47fa-82b1-bf4052e8200a tempest-VolumesCloneTest-63569726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a1c23e48-98a0-47fa-82b1-bf4052e8200a tempest-VolumesCloneTest-63569726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a1c23e48-98a0-47fa-82b1-bf4052e8200a tempest-VolumesCloneTest-63569726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a1c23e48-98a0-47fa-82b1-bf4052e8200a tempest-VolumesCloneTest-63569726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:17 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:33:17 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:18 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-05c23057-4e94-4026-afb6-3170562c4a01 tempest-VolumesCloneTest-63569726 None] Acquiring lock "cinder-57b11338-b78c-4adc-83cb-c880d1210778-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:18 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-05c23057-4e94-4026-afb6-3170562c4a01 tempest-VolumesCloneTest-63569726 None] Lock "cinder-57b11338-b78c-4adc-83cb-c880d1210778-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:18 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-05c23057-4e94-4026-afb6-3170562c4a01 tempest-VolumesCloneTest-63569726 None] Acquiring lock "cinder-quobyte-57b11338-b78c-4adc-83cb-c880d1210778" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:18 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-05c23057-4e94-4026-afb6-3170562c4a01 tempest-VolumesCloneTest-63569726 None] Lock "cinder-quobyte-57b11338-b78c-4adc-83cb-c880d1210778" acquired by "delete_volume" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:18 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b18fc5-96f2-4c04-8117-3811d93fa46b]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-05c23057-4e94-4026-afb6-3170562c4a01 tempest-VolumesCloneTest-63569726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:18 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_79n8p91f" returned: 0 in 0.879s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_79n8p91f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:18 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d 1073741824" returned: 0 in 1.050s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:18 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778 Jul 10 00:33:18 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:18 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_79n8p91f Jul 10 00:33:18 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:18 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d Jul 10 00:33:18 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:18 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a1c23e48-98a0-47fa-82b1-bf4052e8200a tempest-VolumesCloneTest-63569726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.819s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:18 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-a1c23e48-98a0-47fa-82b1-bf4052e8200a tempest-VolumesCloneTest-63569726 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:33:18 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-a1c23e48-98a0-47fa-82b1-bf4052e8200a tempest-VolumesCloneTest-63569726 None] Deleted volume successfully. Jul 10 00:33:18 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a1c23e48-98a0-47fa-82b1-bf4052e8200a tempest-VolumesCloneTest-63569726 None] Lock "cinder-94dc155e-c5ea-4bab-b6ae-b6bf3b4bb1a5-delete_volume" released by "delete_volume" :: held 2.820s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:19 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d" returned: 0 in 0.671s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:33:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.971s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2111274043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2142ba4f-b5a1-47aa-b103-d0a3c0f87379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a27e82cdaeb400cbc1dc5423ebb04a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:33:17Z,use_quota=True,user_id='91a89fc2310445f789b9cd98c4058f18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:33:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Creating volume 2142ba4f-b5a1-47aa-b103-d0a3c0f87379 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:33:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:19 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:33:19 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:33:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_79n8p91f" returned: 1 in 0.814s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_79n8p91f' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:33:19 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9bbcbd-57f2-43ef-a138-50d9661cce34]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_q2d9q3dpdevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:19 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379 1073741824 Jul 10 00:33:19 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:19 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-05c23057-4e94-4026-afb6-3170562c4a01 tempest-VolumesCloneTest-63569726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778" returned: 0 in 0.862s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d0e55d-7c2f-4e10-a1fb-88c526cbb606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a5b6e6-995e-47c2-8542-d2a7faa5923d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-05c23057-4e94-4026-afb6-3170562c4a01 tempest-VolumesCloneTest-63569726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:19 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Volume volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d (fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d): created successfully Jul 10 00:33:19 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778 Jul 10 00:33:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a5b6e6-995e-47c2-8542-d2a7faa5923d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:19 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Flow 'volume_create_manager' (6878841d-9967-487f-b9c0-9dddb8ff5e36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:33:19 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-b55ab225-7f1b-4159-b041-9774c48d8a38 tempest-VolumesSnapshotListTestJSON-477339393 None] Created volume successfully. Jul 10 00:33:19 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_q2d9q3dpdevstack@QuobyteHD Jul 10 00:33:19 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-48dbc321-23b0-4be2-9e48-f0f8c1aeae41 tempest-VolumesSnapshotListTestJSON-477339393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:20 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-05c23057-4e94-4026-afb6-3170562c4a01 tempest-VolumesCloneTest-63569726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-57b11338-b78c-4adc-83cb-c880d1210778" returned: 0 in 0.799s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:20 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_q2d9q3dpdevstack@QuobyteHD" returned: 0 in 0.844s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:20 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] a6d0c978-002e-4d46-ab92-a0880bff49c1 was qcow2, converting to raw {{(pid=88119) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 00:33:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_q2d9q3dpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-05c23057-4e94-4026-afb6-3170562c4a01 tempest-VolumesCloneTest-63569726 None] Lock "cinder-quobyte-57b11338-b78c-4adc-83cb-c880d1210778" released by "delete_volume" :: held 1.747s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:20 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_q2d9q3dpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf Jul 10 00:33:20 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:20 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-05c23057-4e94-4026-afb6-3170562c4a01 tempest-VolumesCloneTest-63569726 None] Created reservations ['9db4a831-44f3-475a-a613-9039a6c6fd81', '6f5ea133-6abe-476b-acd8-9abf11ac304f', '48edaa89-aeb9-46e3-b9eb-be795c9bd76b', '46be3abe-ee4b-4ea5-b448-1050b82986b4'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:33:20 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379 1073741824" returned: 0 in 0.982s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-05c23057-4e94-4026-afb6-3170562c4a01 tempest-VolumesCloneTest-63569726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-05c23057-4e94-4026-afb6-3170562c4a01 tempest-VolumesCloneTest-63569726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:20 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-05c23057-4e94-4026-afb6-3170562c4a01 tempest-VolumesCloneTest-63569726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:20 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-05c23057-4e94-4026-afb6-3170562c4a01 tempest-VolumesCloneTest-63569726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-05c23057-4e94-4026-afb6-3170562c4a01 tempest-VolumesCloneTest-63569726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-05c23057-4e94-4026-afb6-3170562c4a01 tempest-VolumesCloneTest-63569726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:20 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:33:20 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:20 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379 Jul 10 00:33:20 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:20 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-05c23057-4e94-4026-afb6-3170562c4a01 tempest-VolumesCloneTest-63569726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.701s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:20 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-05c23057-4e94-4026-afb6-3170562c4a01 tempest-VolumesCloneTest-63569726 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:33:20 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-05c23057-4e94-4026-afb6-3170562c4a01 tempest-VolumesCloneTest-63569726 None] Deleted volume successfully. Jul 10 00:33:20 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379" returned: 0 in 0.718s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:20 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:33:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-48dbc321-23b0-4be2-9e48-f0f8c1aeae41 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.182s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-05c23057-4e94-4026-afb6-3170562c4a01 tempest-VolumesCloneTest-63569726 None] Lock "cinder-57b11338-b78c-4adc-83cb-c880d1210778-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020f3020-6525-4d18-8f9d-c79617903ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487d67b9-b661-4f64-b597-f32ce38ad657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:20 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-48dbc321-23b0-4be2-9e48-f0f8c1aeae41 tempest-VolumesSnapshotListTestJSON-477339393 None] Creating offline snapshot 778cd669-31eb-4b4f-8358-c8eaa25ffd07 of volume fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:33:20 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Volume volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379 (2142ba4f-b5a1-47aa-b103-d0a3c0f87379): created successfully Jul 10 00:33:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (487d67b9-b661-4f64-b597-f32ce38ad657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:21 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Flow 'volume_create_manager' (33d5c680-d0e9-441c-ad55-cdba29c1f36a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:33:21 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9dd46b-91b1-4b6c-bcf4-080ec2228732]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-48dbc321-23b0-4be2-9e48-f0f8c1aeae41 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:21 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-cbb65b28-3e1d-48c1-8ae5-b9330708a42d tempest-VolumesSnapshotTestJSON-1115347481 None] Created volume successfully. Jul 10 00:33:21 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d Jul 10 00:33:21 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-eb292e2a-a57b-4fa1-aad1-62738eb37c6d tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:22 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-48dbc321-23b0-4be2-9e48-f0f8c1aeae41 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d" returned: 0 in 1.064s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-48dbc321-23b0-4be2-9e48-f0f8c1aeae41 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:22 devstack sudo[98852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07 1G Jul 10 00:33:22 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:22 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_q2d9q3dpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf" returned: 0 in 2.262s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:22 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_q2d9q3dpdevstack@QuobyteHD, size 112.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf {{(pid=88119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:33:22 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Converted 112.00 MB image at 49.48 MB/s Jul 10 00:33:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:22 devstack sudo[98854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf 1G Jul 10 00:33:22 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:22 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-48dbc321-23b0-4be2-9e48-f0f8c1aeae41 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07 1G" returned: 0 in 0.919s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-48dbc321-23b0-4be2-9e48-f0f8c1aeae41 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:23 devstack sudo[98863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07 Jul 10 00:33:23 devstack sudo[98863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:23 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf 1G" returned: 0 in 0.778s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:23 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a682fa-9cf5-42ad-a8c0-ef7ca166ad56]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:23 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf Jul 10 00:33:23 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:23 devstack sudo[98863]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-48dbc321-23b0-4be2-9e48-f0f8c1aeae41 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07" returned: 0 in 0.823s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:23 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-48dbc321-23b0-4be2-9e48-f0f8c1aeae41 tempest-VolumesSnapshotListTestJSON-477339393 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07 is being set with open permissions: ugo+rw Jul 10 00:33:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-48dbc321-23b0-4be2-9e48-f0f8c1aeae41 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:23 devstack sudo[98870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07 Jul 10 00:33:23 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:23 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf" returned: 0 in 0.870s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:24 devstack sudo[98874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf Jul 10 00:33:24 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:24 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:33:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Flow 'volume_create_manager' (b4bb40c6-f539-44b3-88b0-c06a59dc1646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:33:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d832f488-15c8-495e-81dc-beb43ea9dbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d832f488-15c8-495e-81dc-beb43ea9dbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1962928522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9309bd6b-983e-4a59-9739-fbe36c0008bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d321e5e13c4c29afad7f22092881ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:33:24Z,use_quota=True,user_id='6911e614d76045c9a73bcc57df6ee6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2781640-60ba-4eaf-9fc7-700dece7d40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2781640-60ba-4eaf-9fc7-700dece7d40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e51642-88b2-4536-bb44-1c760ef3455b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:24 devstack cinder-volume[88119]: DEBUG cinder.image.glance [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Creating Keystone auth plugin from conf {{(pid=88119) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 00:33:24 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-48dbc321-23b0-4be2-9e48-f0f8c1aeae41 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07" returned: 0 in 0.742s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-48dbc321-23b0-4be2-9e48-f0f8c1aeae41 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:24 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.info Jul 10 00:33:24 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e51642-88b2-4536-bb44-1c760ef3455b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9309bd6b-983e-4a59-9739-fbe36c0008bd', 'volume_name': 'volume-9309bd6b-983e-4a59-9739-fbe36c0008bd', 'volume_size': 1, 'image_id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a6d0c978-002e-4d46-ab92-a0880bff49c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9bf3eaae61a647cbbfcb8c7cdd60fe87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'created_at': datetime.datetime(2026, 7, 9, 22, 17, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 17, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a6d0c978-002e-4d46-ab92-a0880bff49c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1854c24e-6f4f-4494-96e5-85329c6ad68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1854c24e-6f4f-4494-96e5-85329c6ad68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9093df68-5005-4ac8-b6f0-4d5ffc4be0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:24 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Volume 9309bd6b-983e-4a59-9739-fbe36c0008bd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9309bd6b-983e-4a59-9739-fbe36c0008bd', 'volume_size': 1, 'image_id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a6d0c978-002e-4d46-ab92-a0880bff49c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9bf3eaae61a647cbbfcb8c7cdd60fe87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'created_at': datetime.datetime(2026, 7, 9, 22, 17, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 17, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a6d0c978-002e-4d46-ab92-a0880bff49c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 00:33:24 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Trying to clone 9309bd6b-983e-4a59-9739-fbe36c0008bd from image a6d0c978-002e-4d46-ab92-a0880bff49c1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a6d0c978-002e-4d46-ab92-a0880bff49c1', 'metadata': {}}]). {{(pid=88119) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 00:33:24 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf" returned: 1 in 0.815s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:33:24 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Downloaded image a6d0c978-002e-4d46-ab92-a0880bff49c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/a6d0c978-002e-4d46-ab92-a0880bff49c1', 'metadata': {}}])) to volume f8ddab69-9d3b-400f-9baa-81fdf13f06bf successfully. {{(pid=88119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 00:33:24 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Temporary image a6d0c978-002e-4d46-ab92-a0880bff49c1 for user 859a741dbf934adabf9a19ea5ec04a05 is deleted. {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 00:33:24 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Marking volume f8ddab69-9d3b-400f-9baa-81fdf13f06bf as bootable. {{(pid=88119) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 00:33:24 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Copying metadata from image a6d0c978-002e-4d46-ab92-a0880bff49c1 to f8ddab69-9d3b-400f-9baa-81fdf13f06bf. {{(pid=88119) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 00:33:24 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Creating volume glance metadata for volume f8ddab69-9d3b-400f-9baa-81fdf13f06bf backed by image a6d0c978-002e-4d46-ab92-a0880bff49c1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88119) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 00:33:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6258ef08-8b95-4299-9638-7c3e0de969ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf', 'volume_size': 1, 'image_id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a6d0c978-002e-4d46-ab92-a0880bff49c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9bf3eaae61a647cbbfcb8c7cdd60fe87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'created_at': datetime.datetime(2026, 7, 9, 22, 17, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 17, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a6d0c978-002e-4d46-ab92-a0880bff49c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d8da01-6128-48a9-baf3-65cfb7c8923f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:25 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Volume volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf (f8ddab69-9d3b-400f-9baa-81fdf13f06bf): created successfully Jul 10 00:33:25 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d8da01-6128-48a9-baf3-65cfb7c8923f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:25 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Flow 'volume_create_manager' (c4417261-3acb-4560-adb6-f1a6fb87a55c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:33:25 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-2e5c6898-fded-4fb9-a26f-60c642a7ed14 tempest-VolumesImageMetadata-414441180 None] Created volume successfully. Jul 10 00:33:25 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_6x8h5bfldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 00:33:25 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Image download 20.69 MB at 20.69 MB/s Jul 10 00:33:25 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[62347e77-2cf5-4d27-a7da-22ac5b7c5996]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_6x8h5bfldevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:25 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_6x8h5bfldevstack@QuobyteHD Jul 10 00:33:25 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:25 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-48dbc321-23b0-4be2-9e48-f0f8c1aeae41 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.info" returned: 0 in 0.751s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:25 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-48dbc321-23b0-4be2-9e48-f0f8c1aeae41 tempest-VolumesSnapshotListTestJSON-477339393 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.info is being set with open permissions: ugo+rw Jul 10 00:33:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-48dbc321-23b0-4be2-9e48-f0f8c1aeae41 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:25 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.info Jul 10 00:33:25 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:25 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_6x8h5bfldevstack@QuobyteHD" returned: 0 in 0.765s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:25 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Temporary image a6d0c978-002e-4d46-ab92-a0880bff49c1 is fetched for user 6911e614d76045c9a73bcc57df6ee6ca. {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 00:33:26 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dcf00d-76aa-4217-b5a6-711bf79e5389]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_6x8h5bfldevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:26 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-48dbc321-23b0-4be2-9e48-f0f8c1aeae41 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.info" returned: 0 in 0.730s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-48dbc321-23b0-4be2-9e48-f0f8c1aeae41 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.158s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-eb292e2a-a57b-4fa1-aad1-62738eb37c6d tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.356s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-eb292e2a-a57b-4fa1-aad1-62738eb37c6d tempest-VolumesSnapshotTestJSON-1115347481 None] Creating offline snapshot 05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751 of volume 2142ba4f-b5a1-47aa-b103-d0a3c0f87379 {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:33:26 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-48dbc321-23b0-4be2-9e48-f0f8c1aeae41 tempest-VolumesSnapshotListTestJSON-477339393 None] Create snapshot completed successfully Jul 10 00:33:26 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f58dba-404a-4ad9-89e5-6f5894822006]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eb292e2a-a57b-4fa1-aad1-62738eb37c6d tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:26 devstack sudo[98893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_6x8h5bfldevstack@QuobyteHD Jul 10 00:33:26 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:26 devstack sudo[98894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379 Jul 10 00:33:26 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1dac0505-0c2e-44ba-a391-6a9cdb1ff303 tempest-VolumesImageMetadata-414441180 None] Acquiring lock "cinder-f8ddab69-9d3b-400f-9baa-81fdf13f06bf-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1dac0505-0c2e-44ba-a391-6a9cdb1ff303 tempest-VolumesImageMetadata-414441180 None] Lock "cinder-f8ddab69-9d3b-400f-9baa-81fdf13f06bf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1dac0505-0c2e-44ba-a391-6a9cdb1ff303 tempest-VolumesImageMetadata-414441180 None] Acquiring lock "cinder-quobyte-f8ddab69-9d3b-400f-9baa-81fdf13f06bf" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1dac0505-0c2e-44ba-a391-6a9cdb1ff303 tempest-VolumesImageMetadata-414441180 None] Lock "cinder-quobyte-f8ddab69-9d3b-400f-9baa-81fdf13f06bf" acquired by "delete_volume" :: waited 0.022s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:26 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0901f568-7e78-4a13-b5af-08582f407911]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1dac0505-0c2e-44ba-a391-6a9cdb1ff303 tempest-VolumesImageMetadata-414441180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:26 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf Jul 10 00:33:26 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:26 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_6x8h5bfldevstack@QuobyteHD" returned: 0 in 0.776s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:27 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eb292e2a-a57b-4fa1-aad1-62738eb37c6d tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379" returned: 0 in 0.878s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eb292e2a-a57b-4fa1-aad1-62738eb37c6d tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:27 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751 1G Jul 10 00:33:27 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8e6bed5f-7fd9-4ce8-85fe-df6088e4f603 tempest-VolumesSnapshotListTestJSON-477339393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:27 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1dac0505-0c2e-44ba-a391-6a9cdb1ff303 tempest-VolumesImageMetadata-414441180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf" returned: 0 in 0.824s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1dac0505-0c2e-44ba-a391-6a9cdb1ff303 tempest-VolumesImageMetadata-414441180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:27 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf Jul 10 00:33:27 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:27 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eb292e2a-a57b-4fa1-aad1-62738eb37c6d tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751 1G" returned: 0 in 0.823s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eb292e2a-a57b-4fa1-aad1-62738eb37c6d tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:27 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751 Jul 10 00:33:27 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:28 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1dac0505-0c2e-44ba-a391-6a9cdb1ff303 tempest-VolumesImageMetadata-414441180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf" returned: 1 in 0.749s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1dac0505-0c2e-44ba-a391-6a9cdb1ff303 tempest-VolumesImageMetadata-414441180 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:33:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1dac0505-0c2e-44ba-a391-6a9cdb1ff303 tempest-VolumesImageMetadata-414441180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:28 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf Jul 10 00:33:28 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:28 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eb292e2a-a57b-4fa1-aad1-62738eb37c6d tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751" returned: 0 in 0.736s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:28 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-eb292e2a-a57b-4fa1-aad1-62738eb37c6d tempest-VolumesSnapshotTestJSON-1115347481 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751 is being set with open permissions: ugo+rw Jul 10 00:33:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eb292e2a-a57b-4fa1-aad1-62738eb37c6d tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:28 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751 Jul 10 00:33:28 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:28 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1dac0505-0c2e-44ba-a391-6a9cdb1ff303 tempest-VolumesImageMetadata-414441180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f8ddab69-9d3b-400f-9baa-81fdf13f06bf" returned: 0 in 0.629s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:28 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1dac0505-0c2e-44ba-a391-6a9cdb1ff303 tempest-VolumesImageMetadata-414441180 None] Lock "cinder-quobyte-f8ddab69-9d3b-400f-9baa-81fdf13f06bf" released by "delete_volume" :: held 2.279s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:28 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-1dac0505-0c2e-44ba-a391-6a9cdb1ff303 tempest-VolumesImageMetadata-414441180 None] Created reservations ['acbc5509-0979-4f05-826a-a57405f7a5ad', '8da0640b-7266-4b56-8e24-302921cb82ef', '996a3cbc-267d-41b4-8afc-b25ef07bd605', 'be35c423-2bc6-48db-9e40-43810b0a2bef'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:33:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1dac0505-0c2e-44ba-a391-6a9cdb1ff303 tempest-VolumesImageMetadata-414441180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1dac0505-0c2e-44ba-a391-6a9cdb1ff303 tempest-VolumesImageMetadata-414441180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1dac0505-0c2e-44ba-a391-6a9cdb1ff303 tempest-VolumesImageMetadata-414441180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1dac0505-0c2e-44ba-a391-6a9cdb1ff303 tempest-VolumesImageMetadata-414441180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1dac0505-0c2e-44ba-a391-6a9cdb1ff303 tempest-VolumesImageMetadata-414441180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1dac0505-0c2e-44ba-a391-6a9cdb1ff303 tempest-VolumesImageMetadata-414441180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:28 devstack sudo[98928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:33:28 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:29 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eb292e2a-a57b-4fa1-aad1-62738eb37c6d tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751" returned: 0 in 0.653s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eb292e2a-a57b-4fa1-aad1-62738eb37c6d tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:29 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.info Jul 10 00:33:29 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:29 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1dac0505-0c2e-44ba-a391-6a9cdb1ff303 tempest-VolumesImageMetadata-414441180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.616s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:29 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-1dac0505-0c2e-44ba-a391-6a9cdb1ff303 tempest-VolumesImageMetadata-414441180 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:33:29 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-1dac0505-0c2e-44ba-a391-6a9cdb1ff303 tempest-VolumesImageMetadata-414441180 None] Deleted volume successfully. Jul 10 00:33:29 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1dac0505-0c2e-44ba-a391-6a9cdb1ff303 tempest-VolumesImageMetadata-414441180 None] Lock "cinder-f8ddab69-9d3b-400f-9baa-81fdf13f06bf-delete_volume" released by "delete_volume" :: held 3.114s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:29 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eb292e2a-a57b-4fa1-aad1-62738eb37c6d tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.info" returned: 0 in 0.668s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:29 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-eb292e2a-a57b-4fa1-aad1-62738eb37c6d tempest-VolumesSnapshotTestJSON-1115347481 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.info is being set with open permissions: ugo+rw Jul 10 00:33:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eb292e2a-a57b-4fa1-aad1-62738eb37c6d tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:29 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.info Jul 10 00:33:29 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:30 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eb292e2a-a57b-4fa1-aad1-62738eb37c6d tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.info" returned: 0 in 0.670s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-eb292e2a-a57b-4fa1-aad1-62738eb37c6d tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.534s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.812s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:30 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1962928522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9309bd6b-983e-4a59-9739-fbe36c0008bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d321e5e13c4c29afad7f22092881ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:33:24Z,use_quota=True,user_id='6911e614d76045c9a73bcc57df6ee6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:33:30 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Creating volume 9309bd6b-983e-4a59-9739-fbe36c0008bd {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:33:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:30 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:30 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:30 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:33:30 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:33:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:30 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd 1073741824 Jul 10 00:33:30 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:30 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-eb292e2a-a57b-4fa1-aad1-62738eb37c6d tempest-VolumesSnapshotTestJSON-1115347481 None] Create snapshot completed successfully Jul 10 00:33:31 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b85c3820-b243-4082-8e72-55491a200a36 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "cinder-05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:31 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b85c3820-b243-4082-8e72-55491a200a36 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:31 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b85c3820-b243-4082-8e72-55491a200a36 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "cinder-quobyte-2142ba4f-b5a1-47aa-b103-d0a3c0f87379" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:31 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b85c3820-b243-4082-8e72-55491a200a36 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-2142ba4f-b5a1-47aa-b103-d0a3c0f87379" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:31 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b85c3820-b243-4082-8e72-55491a200a36 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "cinder-quobyte-05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:31 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b85c3820-b243-4082-8e72-55491a200a36 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-b85c3820-b243-4082-8e72-55491a200a36 tempest-VolumesSnapshotTestJSON-1115347481 None] Deleting offline snapshot 05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751 of volume 2142ba4f-b5a1-47aa-b103-d0a3c0f87379 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:33:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-b85c3820-b243-4082-8e72-55491a200a36 tempest-VolumesSnapshotTestJSON-1115347481 None] snapshot_file for this snap is: volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:33:31 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[09feb5d5-5da9-4220-b008-399f0c4fc7d5]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b85c3820-b243-4082-8e72-55491a200a36 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:31 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751 Jul 10 00:33:31 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:33:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:31 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd 1073741824" returned: 0 in 0.982s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:31 devstack sudo[98947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:33:31 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:31 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd Jul 10 00:33:31 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:32 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b85c3820-b243-4082-8e72-55491a200a36 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751" returned: 0 in 1.027s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-b85c3820-b243-4082-8e72-55491a200a36 tempest-VolumesSnapshotTestJSON-1115347481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:33:32 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:32 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd" returned: 0 in 0.814s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:33:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.875s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8e6bed5f-7fd9-4ce8-85fe-df6088e4f603 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.216s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:32 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:33:32 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b8a6a9-c671-49a9-93dd-2f1ecc50c0dd]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b85c3820-b243-4082-8e72-55491a200a36 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:32 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:33:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 29 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:33:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:33:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8e6bed5f-7fd9-4ce8-85fe-df6088e4f603 tempest-VolumesSnapshotListTestJSON-477339393 None] Creating offline snapshot 8819791a-6990-40e3-9629-968047397bd9 of volume fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:33:32 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde2c9c8-e685-402c-ab6d-a96495f67820]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8e6bed5f-7fd9-4ce8-85fe-df6088e4f603 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:32 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Attempting download of a6d0c978-002e-4d46-ab92-a0880bff49c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/a6d0c978-002e-4d46-ab92-a0880bff49c1', 'metadata': {}}])) to volume 9309bd6b-983e-4a59-9739-fbe36c0008bd. {{(pid=88119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 00:33:32 devstack sudo[98956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379 Jul 10 00:33:32 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:32 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4f0fe0-d1ec-474a-b7ed-a5b8e1abbf53]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_uo8awlze {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:32 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07 Jul 10 00:33:32 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:32 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_uo8awlze Jul 10 00:33:32 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:33 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_uo8awlze" returned: 0 in 0.809s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_uo8awlze {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:33 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8e6bed5f-7fd9-4ce8-85fe-df6088e4f603 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07" returned: 0 in 0.916s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8e6bed5f-7fd9-4ce8-85fe-df6088e4f603 tempest-VolumesSnapshotListTestJSON-477339393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:33:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8e6bed5f-7fd9-4ce8-85fe-df6088e4f603 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:33 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9 1G Jul 10 00:33:33 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:33 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b85c3820-b243-4082-8e72-55491a200a36 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379" returned: 0 in 1.068s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b85c3820-b243-4082-8e72-55491a200a36 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:33 devstack sudo[99008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751 Jul 10 00:33:33 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:33 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_uo8awlze Jul 10 00:33:33 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:34 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:33:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Flow 'volume_create_manager' (5e09612e-ccea-4db6-8381-7aac9d0c059f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:33:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (279bbc76-77d0-4df5-a6b4-f4fae67b7b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (279bbc76-77d0-4df5-a6b4-f4fae67b7b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1453639526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e38373d0-ffca-4bc0-b68f-a92e765150f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb172c37a354ed7b57ffc958a3a7103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:33:34Z,use_quota=True,user_id='859079e7bb584d7385aa57cefd6a60e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1efcb7-8cc1-4d8f-a160-f67cb589e679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1efcb7-8cc1-4d8f-a160-f67cb589e679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cba5dd51-9aab-4f3c-a79f-686efb680ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cba5dd51-9aab-4f3c-a79f-686efb680ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e38373d0-ffca-4bc0-b68f-a92e765150f0', 'volume_name': 'volume-e38373d0-ffca-4bc0-b68f-a92e765150f0', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (753f8520-7611-4be0-bd08-7ea976d8964d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (753f8520-7611-4be0-bd08-7ea976d8964d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b3c909-6015-4b06-8e80-720edc44256c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:34 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Volume e38373d0-ffca-4bc0-b68f-a92e765150f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e38373d0-ffca-4bc0-b68f-a92e765150f0', 'volume_size': 1} Jul 10 00:33:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:34 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b85c3820-b243-4082-8e72-55491a200a36 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751" returned: 0 in 0.908s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b85c3820-b243-4082-8e72-55491a200a36 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:34 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751 Jul 10 00:33:34 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:34 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_uo8awlze" returned: 1 in 1.112s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_uo8awlze' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:33:34 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2cde23-2c23-4b92-9845-3caa9adc2f17]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_6x8h5bfldevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:34 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_6x8h5bfldevstack@QuobyteHD Jul 10 00:33:34 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:34 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8e6bed5f-7fd9-4ce8-85fe-df6088e4f603 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9 1G" returned: 0 in 1.229s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8e6bed5f-7fd9-4ce8-85fe-df6088e4f603 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:34 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9 Jul 10 00:33:34 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:35 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b85c3820-b243-4082-8e72-55491a200a36 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379.05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751" returned: 0 in 0.698s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b85c3820-b243-4082-8e72-55491a200a36 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751" released by "_delete_snapshot" :: held 3.864s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b85c3820-b243-4082-8e72-55491a200a36 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-2142ba4f-b5a1-47aa-b103-d0a3c0f87379" released by "delete_snapshot" :: held 3.894s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:35 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-b85c3820-b243-4082-8e72-55491a200a36 tempest-VolumesSnapshotTestJSON-1115347481 None] Created reservations ['b7b1369c-d041-4fb8-91b1-395a7fd42780', '71de1052-c570-4235-8a53-b5ce7a62d1b9', '48438361-84ec-4fe6-b9dc-26932f175749', '034b18e3-bf1b-4cd7-86e2-17492fd9a4c9'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:33:35 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-b85c3820-b243-4082-8e72-55491a200a36 tempest-VolumesSnapshotTestJSON-1115347481 None] Delete snapshot completed successfully. Jul 10 00:33:35 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_6x8h5bfldevstack@QuobyteHD" returned: 0 in 0.786s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:35 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] a6d0c978-002e-4d46-ab92-a0880bff49c1 was qcow2, converting to raw {{(pid=88119) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 00:33:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_6x8h5bfldevstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b85c3820-b243-4082-8e72-55491a200a36 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-05f5043d-9e0b-4ed7-90d8-6fc6ccbf0751-delete_snapshot" released by "delete_snapshot" :: held 4.110s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:35 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_6x8h5bfldevstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd Jul 10 00:33:35 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:35 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8e6bed5f-7fd9-4ce8-85fe-df6088e4f603 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9" returned: 0 in 0.763s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:35 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-8e6bed5f-7fd9-4ce8-85fe-df6088e4f603 tempest-VolumesSnapshotListTestJSON-477339393 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9 is being set with open permissions: ugo+rw Jul 10 00:33:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8e6bed5f-7fd9-4ce8-85fe-df6088e4f603 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:35 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9 Jul 10 00:33:35 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:36 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:33:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Flow 'volume_create_manager' (ec6b844f-c0c8-4349-9e77-68d1aea0e3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:33:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6c2642-fe37-45b7-9bce-2c807d71e817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6c2642-fe37-45b7-9bce-2c807d71e817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1737795439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a9d67b-2ae2-4166-a5e6-f1abd6fd28be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a27e82cdaeb400cbc1dc5423ebb04a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:33:36Z,use_quota=True,user_id='91a89fc2310445f789b9cd98c4058f18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca9296e9-8b71-4efe-bf22-376fe7f11ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca9296e9-8b71-4efe-bf22-376fe7f11ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b16fdc-5c00-40e4-8cc7-1991de901269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14b16fdc-5c00-40e4-8cc7-1991de901269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84a9d67b-2ae2-4166-a5e6-f1abd6fd28be', 'volume_name': 'volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73465648-dce6-4eab-aedc-1457d105f802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73465648-dce6-4eab-aedc-1457d105f802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbeb04ce-5c80-4165-96c0-3fa0fc46431a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:36 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Volume 84a9d67b-2ae2-4166-a5e6-f1abd6fd28be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be', 'volume_size': 1} Jul 10 00:33:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:36 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8e6bed5f-7fd9-4ce8-85fe-df6088e4f603 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9" returned: 0 in 0.748s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8e6bed5f-7fd9-4ce8-85fe-df6088e4f603 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.811s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.908s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:36 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1453639526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e38373d0-ffca-4bc0-b68f-a92e765150f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb172c37a354ed7b57ffc958a3a7103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:33:34Z,use_quota=True,user_id='859079e7bb584d7385aa57cefd6a60e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:33:36 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Creating volume e38373d0-ffca-4bc0-b68f-a92e765150f0 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:33:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:36 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:36 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:36 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:33:36 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:33:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e38373d0-ffca-4bc0-b68f-a92e765150f0 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:36 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e38373d0-ffca-4bc0-b68f-a92e765150f0 1073741824 Jul 10 00:33:36 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:36 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-8e6bed5f-7fd9-4ce8-85fe-df6088e4f603 tempest-VolumesSnapshotListTestJSON-477339393 None] Create snapshot completed successfully Jul 10 00:33:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-95ce65d6-8096-4573-864c-d25914b68e0b tempest-VolumesSnapshotListTestJSON-477339393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:37 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e38373d0-ffca-4bc0-b68f-a92e765150f0 1073741824" returned: 0 in 0.944s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e38373d0-ffca-4bc0-b68f-a92e765150f0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:37 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e38373d0-ffca-4bc0-b68f-a92e765150f0 Jul 10 00:33:37 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:37 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_6x8h5bfldevstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd" returned: 0 in 2.210s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:37 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_6x8h5bfldevstack@QuobyteHD, size 112.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd {{(pid=88119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:33:37 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Converted 112.00 MB image at 50.65 MB/s Jul 10 00:33:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:37 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd 1G Jul 10 00:33:37 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:37 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e38373d0-ffca-4bc0-b68f-a92e765150f0" returned: 0 in 0.673s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:33:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.720s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1737795439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a9d67b-2ae2-4166-a5e6-f1abd6fd28be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a27e82cdaeb400cbc1dc5423ebb04a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:33:36Z,use_quota=True,user_id='91a89fc2310445f789b9cd98c4058f18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:33:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Creating volume 84a9d67b-2ae2-4166-a5e6-f1abd6fd28be {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:33:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:33:37 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:33:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:38 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be 1073741824 Jul 10 00:33:38 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b3c909-6015-4b06-8e80-720edc44256c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e38373d0-ffca-4bc0-b68f-a92e765150f0', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe397d5-3bf3-4ebd-9819-921fc6f18ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:38 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Volume volume-e38373d0-ffca-4bc0-b68f-a92e765150f0 (e38373d0-ffca-4bc0-b68f-a92e765150f0): created successfully Jul 10 00:33:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe397d5-3bf3-4ebd-9819-921fc6f18ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Flow 'volume_create_manager' (5e09612e-ccea-4db6-8381-7aac9d0c059f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:33:38 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-be5b67b0-b885-402d-9c34-343e89dc1ec3 tempest-AbsoluteLimitsTests-1919487189 None] Created volume successfully. Jul 10 00:33:38 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd 1G" returned: 0 in 0.693s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:38 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[82268f25-690b-46c7-a2d7-c3d54871b29f]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:38 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd Jul 10 00:33:38 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:38 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-4031f4db-a438-494d-8b0a-ee300fa30927 tempest-AbsoluteLimitsTests-1919487189 None] Acquiring lock "cinder-e38373d0-ffca-4bc0-b68f-a92e765150f0-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:38 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-4031f4db-a438-494d-8b0a-ee300fa30927 tempest-AbsoluteLimitsTests-1919487189 None] Lock "cinder-e38373d0-ffca-4bc0-b68f-a92e765150f0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:38 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-4031f4db-a438-494d-8b0a-ee300fa30927 tempest-AbsoluteLimitsTests-1919487189 None] Acquiring lock "cinder-quobyte-e38373d0-ffca-4bc0-b68f-a92e765150f0" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:38 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-4031f4db-a438-494d-8b0a-ee300fa30927 tempest-AbsoluteLimitsTests-1919487189 None] Lock "cinder-quobyte-e38373d0-ffca-4bc0-b68f-a92e765150f0" acquired by "delete_volume" :: waited 0.021s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:38 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ad5f32-fbfa-4422-acd9-1853eb502efc]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4031f4db-a438-494d-8b0a-ee300fa30927 tempest-AbsoluteLimitsTests-1919487189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e38373d0-ffca-4bc0-b68f-a92e765150f0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:38 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be 1073741824" returned: 0 in 0.974s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:39 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e38373d0-ffca-4bc0-b68f-a92e765150f0 Jul 10 00:33:39 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:39 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be Jul 10 00:33:39 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:39 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd" returned: 0 in 0.881s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:39 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd Jul 10 00:33:39 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:39 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be" returned: 0 in 0.676s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:39 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:33:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-95ce65d6-8096-4573-864c-d25914b68e0b tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.781s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:39 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4031f4db-a438-494d-8b0a-ee300fa30927 tempest-AbsoluteLimitsTests-1919487189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e38373d0-ffca-4bc0-b68f-a92e765150f0" returned: 0 in 0.821s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4031f4db-a438-494d-8b0a-ee300fa30927 tempest-AbsoluteLimitsTests-1919487189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e38373d0-ffca-4bc0-b68f-a92e765150f0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbeb04ce-5c80-4165-96c0-3fa0fc46431a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:39 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e38373d0-ffca-4bc0-b68f-a92e765150f0 Jul 10 00:33:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc74988c-944d-4a6e-bd3d-44b045e23a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:39 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:39 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-95ce65d6-8096-4573-864c-d25914b68e0b tempest-VolumesSnapshotListTestJSON-477339393 None] Creating offline snapshot 1e604e1d-f782-4626-ae7c-7f2f3eb08d5c of volume fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:33:39 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Volume volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be (84a9d67b-2ae2-4166-a5e6-f1abd6fd28be): created successfully Jul 10 00:33:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc74988c-944d-4a6e-bd3d-44b045e23a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Flow 'volume_create_manager' (ec6b844f-c0c8-4349-9e77-68d1aea0e3e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:33:39 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[93aed486-3a3a-450d-a16c-31a4ef86b7a4]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-95ce65d6-8096-4573-864c-d25914b68e0b tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:39 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-7515e35f-6739-4524-96fb-56ba504f9e4b tempest-VolumesSnapshotTestJSON-1115347481 None] Created volume successfully. Jul 10 00:33:39 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9 Jul 10 00:33:39 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:40 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd" returned: 1 in 0.806s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:33:40 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Downloaded image a6d0c978-002e-4d46-ab92-a0880bff49c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/a6d0c978-002e-4d46-ab92-a0880bff49c1', 'metadata': {}}])) to volume 9309bd6b-983e-4a59-9739-fbe36c0008bd successfully. {{(pid=88119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 00:33:40 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Temporary image a6d0c978-002e-4d46-ab92-a0880bff49c1 for user 6911e614d76045c9a73bcc57df6ee6ca is deleted. {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 00:33:40 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Marking volume 9309bd6b-983e-4a59-9739-fbe36c0008bd as bootable. {{(pid=88119) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 00:33:40 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Copying metadata from image a6d0c978-002e-4d46-ab92-a0880bff49c1 to 9309bd6b-983e-4a59-9739-fbe36c0008bd. {{(pid=88119) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 00:33:40 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Creating volume glance metadata for volume 9309bd6b-983e-4a59-9739-fbe36c0008bd backed by image a6d0c978-002e-4d46-ab92-a0880bff49c1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88119) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 00:33:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9093df68-5005-4ac8-b6f0-4d5ffc4be0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9309bd6b-983e-4a59-9739-fbe36c0008bd', 'volume_size': 1, 'image_id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a6d0c978-002e-4d46-ab92-a0880bff49c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9bf3eaae61a647cbbfcb8c7cdd60fe87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'created_at': datetime.datetime(2026, 7, 9, 22, 17, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 17, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a6d0c978-002e-4d46-ab92-a0880bff49c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a0ebbe9-3fe8-4a3d-b4c8-125965ab133b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:40 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Volume volume-9309bd6b-983e-4a59-9739-fbe36c0008bd (9309bd6b-983e-4a59-9739-fbe36c0008bd): created successfully Jul 10 00:33:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a0ebbe9-3fe8-4a3d-b4c8-125965ab133b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Flow 'volume_create_manager' (b4bb40c6-f539-44b3-88b0-c06a59dc1646) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:33:40 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-4fbfe22b-4fe7-476c-8fdd-e67ec6c98a6e tempest-VolumesExtendTest-2140193734 None] Created volume successfully. Jul 10 00:33:40 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4031f4db-a438-494d-8b0a-ee300fa30927 tempest-AbsoluteLimitsTests-1919487189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e38373d0-ffca-4bc0-b68f-a92e765150f0" returned: 0 in 0.710s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:40 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-4031f4db-a438-494d-8b0a-ee300fa30927 tempest-AbsoluteLimitsTests-1919487189 None] Lock "cinder-quobyte-e38373d0-ffca-4bc0-b68f-a92e765150f0" released by "delete_volume" :: held 1.588s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:40 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-4031f4db-a438-494d-8b0a-ee300fa30927 tempest-AbsoluteLimitsTests-1919487189 None] Created reservations ['ddf855e9-4fe3-4193-a121-01cc5b9a0dc1', '9503b94e-e2a1-47f7-93a7-5a37a12fc527', 'd7442d53-7bbc-4348-a1f6-9f8a21ae70e6', 'f34c3488-0d3b-45ac-bfc3-2cadf415d64b'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:33:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-349707a4-cf2b-4076-8482-2c4ca8343a26 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4031f4db-a438-494d-8b0a-ee300fa30927 tempest-AbsoluteLimitsTests-1919487189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4031f4db-a438-494d-8b0a-ee300fa30927 tempest-AbsoluteLimitsTests-1919487189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4031f4db-a438-494d-8b0a-ee300fa30927 tempest-AbsoluteLimitsTests-1919487189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4031f4db-a438-494d-8b0a-ee300fa30927 tempest-AbsoluteLimitsTests-1919487189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4031f4db-a438-494d-8b0a-ee300fa30927 tempest-AbsoluteLimitsTests-1919487189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4031f4db-a438-494d-8b0a-ee300fa30927 tempest-AbsoluteLimitsTests-1919487189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:40 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-95ce65d6-8096-4573-864c-d25914b68e0b tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9" returned: 0 in 0.838s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-95ce65d6-8096-4573-864c-d25914b68e0b tempest-VolumesSnapshotListTestJSON-477339393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:33:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-95ce65d6-8096-4573-864c-d25914b68e0b tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.1e604e1d-f782-4626-ae7c-7f2f3eb08d5c 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:40 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:33:40 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:40 devstack sudo[99101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.1e604e1d-f782-4626-ae7c-7f2f3eb08d5c 1G Jul 10 00:33:40 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-215dd815-df3f-4d53-ba09-bcf3281a23e4 tempest-VolumesExtendTest-2140193734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:41 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4031f4db-a438-494d-8b0a-ee300fa30927 tempest-AbsoluteLimitsTests-1919487189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.679s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:41 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-4031f4db-a438-494d-8b0a-ee300fa30927 tempest-AbsoluteLimitsTests-1919487189 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:33:41 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-4031f4db-a438-494d-8b0a-ee300fa30927 tempest-AbsoluteLimitsTests-1919487189 None] Deleted volume successfully. Jul 10 00:33:41 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-4031f4db-a438-494d-8b0a-ee300fa30927 tempest-AbsoluteLimitsTests-1919487189 None] Lock "cinder-e38373d0-ffca-4bc0-b68f-a92e765150f0-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:41 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-95ce65d6-8096-4573-864c-d25914b68e0b tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.1e604e1d-f782-4626-ae7c-7f2f3eb08d5c 1G" returned: 0 in 0.908s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-95ce65d6-8096-4573-864c-d25914b68e0b tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.1e604e1d-f782-4626-ae7c-7f2f3eb08d5c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:41 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.1e604e1d-f782-4626-ae7c-7f2f3eb08d5c Jul 10 00:33:41 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:42 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-95ce65d6-8096-4573-864c-d25914b68e0b tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.1e604e1d-f782-4626-ae7c-7f2f3eb08d5c" returned: 0 in 0.721s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:42 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-95ce65d6-8096-4573-864c-d25914b68e0b tempest-VolumesSnapshotListTestJSON-477339393 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.1e604e1d-f782-4626-ae7c-7f2f3eb08d5c is being set with open permissions: ugo+rw Jul 10 00:33:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-95ce65d6-8096-4573-864c-d25914b68e0b tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.1e604e1d-f782-4626-ae7c-7f2f3eb08d5c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:42 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.1e604e1d-f782-4626-ae7c-7f2f3eb08d5c Jul 10 00:33:42 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:42 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-95ce65d6-8096-4573-864c-d25914b68e0b tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.1e604e1d-f782-4626-ae7c-7f2f3eb08d5c" returned: 0 in 0.678s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-95ce65d6-8096-4573-864c-d25914b68e0b tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.301s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-349707a4-cf2b-4076-8482-2c4ca8343a26 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.446s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-349707a4-cf2b-4076-8482-2c4ca8343a26 tempest-VolumesSnapshotTestJSON-1115347481 None] Creating offline snapshot 37c3059a-76c1-411c-99cb-17ba19fd2061 of volume 84a9d67b-2ae2-4166-a5e6-f1abd6fd28be {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:33:43 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85befb2-5382-452a-971f-77350f021015]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-349707a4-cf2b-4076-8482-2c4ca8343a26 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:43 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-95ce65d6-8096-4573-864c-d25914b68e0b tempest-VolumesSnapshotListTestJSON-477339393 None] Create snapshot completed successfully Jul 10 00:33:43 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be Jul 10 00:33:43 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:43 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-349707a4-cf2b-4076-8482-2c4ca8343a26 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be" returned: 0 in 0.870s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-349707a4-cf2b-4076-8482-2c4ca8343a26 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.37c3059a-76c1-411c-99cb-17ba19fd2061 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:43 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.37c3059a-76c1-411c-99cb-17ba19fd2061 1G Jul 10 00:33:43 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d9513f06-c2d9-4da1-9bfb-8af31ac01e53 tempest-VolumesSnapshotListTestJSON-477339393 None] Acquiring lock "cinder-1e604e1d-f782-4626-ae7c-7f2f3eb08d5c-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:44 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d9513f06-c2d9-4da1-9bfb-8af31ac01e53 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "cinder-1e604e1d-f782-4626-ae7c-7f2f3eb08d5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:44 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d9513f06-c2d9-4da1-9bfb-8af31ac01e53 tempest-VolumesSnapshotListTestJSON-477339393 None] Acquiring lock "cinder-quobyte-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:44 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d9513f06-c2d9-4da1-9bfb-8af31ac01e53 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "cinder-quobyte-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:44 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d9513f06-c2d9-4da1-9bfb-8af31ac01e53 tempest-VolumesSnapshotListTestJSON-477339393 None] Acquiring lock "cinder-quobyte-1e604e1d-f782-4626-ae7c-7f2f3eb08d5c" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:44 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d9513f06-c2d9-4da1-9bfb-8af31ac01e53 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "cinder-quobyte-1e604e1d-f782-4626-ae7c-7f2f3eb08d5c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-d9513f06-c2d9-4da1-9bfb-8af31ac01e53 tempest-VolumesSnapshotListTestJSON-477339393 None] Deleting offline snapshot 1e604e1d-f782-4626-ae7c-7f2f3eb08d5c of volume fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:33:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-d9513f06-c2d9-4da1-9bfb-8af31ac01e53 tempest-VolumesSnapshotListTestJSON-477339393 None] snapshot_file for this snap is: volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.1e604e1d-f782-4626-ae7c-7f2f3eb08d5c {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:33:44 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f69669-213c-4e55-86cc-350017708432]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d9513f06-c2d9-4da1-9bfb-8af31ac01e53 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.1e604e1d-f782-4626-ae7c-7f2f3eb08d5c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:44 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.1e604e1d-f782-4626-ae7c-7f2f3eb08d5c Jul 10 00:33:44 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:44 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-349707a4-cf2b-4076-8482-2c4ca8343a26 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.37c3059a-76c1-411c-99cb-17ba19fd2061 1G" returned: 0 in 0.898s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-349707a4-cf2b-4076-8482-2c4ca8343a26 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.37c3059a-76c1-411c-99cb-17ba19fd2061 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:44 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.37c3059a-76c1-411c-99cb-17ba19fd2061 Jul 10 00:33:44 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:44 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d9513f06-c2d9-4da1-9bfb-8af31ac01e53 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.1e604e1d-f782-4626-ae7c-7f2f3eb08d5c" returned: 0 in 0.785s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-d9513f06-c2d9-4da1-9bfb-8af31ac01e53 tempest-VolumesSnapshotListTestJSON-477339393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:33:44 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2e6eba-b95b-44a2-9188-eb52237a199b]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d9513f06-c2d9-4da1-9bfb-8af31ac01e53 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:45 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9 Jul 10 00:33:45 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:45 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:33:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Flow 'volume_create_manager' (5b3991c2-36d0-45ba-9cdb-3c5b63160bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:33:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9043defb-e2d5-4d5f-811b-cd87b9d4b188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9043defb-e2d5-4d5f-811b-cd87b9d4b188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-925096569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13d36a3-d6c2-499f-bd0d-95a5f568df75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee5d8778838c4974ada006372cc34212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:33:45Z,use_quota=True,user_id='3417d97f3a52415b908f2c977100b087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab7a885-d913-40f2-8a26-982f29e3f2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab7a885-d913-40f2-8a26-982f29e3f2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b966b6-9153-431f-ba4f-66b47b54c7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b966b6-9153-431f-ba4f-66b47b54c7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f13d36a3-d6c2-499f-bd0d-95a5f568df75', 'volume_name': 'volume-f13d36a3-d6c2-499f-bd0d-95a5f568df75', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0823321-e4af-454f-9fc4-76822a02454c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0823321-e4af-454f-9fc4-76822a02454c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5868d23-0b84-4904-888b-9c6e86834ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:45 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Volume f13d36a3-d6c2-499f-bd0d-95a5f568df75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f13d36a3-d6c2-499f-bd0d-95a5f568df75', 'volume_size': 1} Jul 10 00:33:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:45 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-349707a4-cf2b-4076-8482-2c4ca8343a26 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.37c3059a-76c1-411c-99cb-17ba19fd2061" returned: 0 in 0.723s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:45 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-349707a4-cf2b-4076-8482-2c4ca8343a26 tempest-VolumesSnapshotTestJSON-1115347481 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.37c3059a-76c1-411c-99cb-17ba19fd2061 is being set with open permissions: ugo+rw Jul 10 00:33:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-349707a4-cf2b-4076-8482-2c4ca8343a26 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.37c3059a-76c1-411c-99cb-17ba19fd2061 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:45 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.37c3059a-76c1-411c-99cb-17ba19fd2061 Jul 10 00:33:45 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:45 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d9513f06-c2d9-4da1-9bfb-8af31ac01e53 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9" returned: 0 in 0.840s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-d9513f06-c2d9-4da1-9bfb-8af31ac01e53 tempest-VolumesSnapshotListTestJSON-477339393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:33:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d9513f06-c2d9-4da1-9bfb-8af31ac01e53 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.1e604e1d-f782-4626-ae7c-7f2f3eb08d5c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:45 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.1e604e1d-f782-4626-ae7c-7f2f3eb08d5c Jul 10 00:33:45 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:46 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-349707a4-cf2b-4076-8482-2c4ca8343a26 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.37c3059a-76c1-411c-99cb-17ba19fd2061" returned: 0 in 0.635s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-349707a4-cf2b-4076-8482-2c4ca8343a26 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:46 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.info Jul 10 00:33:46 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:46 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d9513f06-c2d9-4da1-9bfb-8af31ac01e53 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.1e604e1d-f782-4626-ae7c-7f2f3eb08d5c" returned: 0 in 0.844s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d9513f06-c2d9-4da1-9bfb-8af31ac01e53 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.1e604e1d-f782-4626-ae7c-7f2f3eb08d5c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:46 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.1e604e1d-f782-4626-ae7c-7f2f3eb08d5c Jul 10 00:33:46 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:46 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-349707a4-cf2b-4076-8482-2c4ca8343a26 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.info" returned: 0 in 0.648s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:46 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-349707a4-cf2b-4076-8482-2c4ca8343a26 tempest-VolumesSnapshotTestJSON-1115347481 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.info is being set with open permissions: ugo+rw Jul 10 00:33:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-349707a4-cf2b-4076-8482-2c4ca8343a26 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:46 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.info Jul 10 00:33:46 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:47 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d9513f06-c2d9-4da1-9bfb-8af31ac01e53 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.1e604e1d-f782-4626-ae7c-7f2f3eb08d5c" returned: 0 in 0.656s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d9513f06-c2d9-4da1-9bfb-8af31ac01e53 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "cinder-quobyte-1e604e1d-f782-4626-ae7c-7f2f3eb08d5c" released by "_delete_snapshot" :: held 3.251s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d9513f06-c2d9-4da1-9bfb-8af31ac01e53 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "cinder-quobyte-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d" released by "delete_snapshot" :: held 3.282s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:47 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-d9513f06-c2d9-4da1-9bfb-8af31ac01e53 tempest-VolumesSnapshotListTestJSON-477339393 None] Created reservations ['57f32ada-3d26-4fba-ba31-45f57c701639', '137b4fe7-e255-4e2a-a09c-6e0b747e9e7e', '56eb3fcc-6494-4abb-9cb9-65301060dc7c', 'cedaaf0c-6f4c-4535-ba46-f4ab4fe8a4f2'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:33:47 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-d9513f06-c2d9-4da1-9bfb-8af31ac01e53 tempest-VolumesSnapshotListTestJSON-477339393 None] Delete snapshot completed successfully. Jul 10 00:33:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d9513f06-c2d9-4da1-9bfb-8af31ac01e53 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "cinder-1e604e1d-f782-4626-ae7c-7f2f3eb08d5c-delete_snapshot" released by "delete_snapshot" :: held 3.436s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:47 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-349707a4-cf2b-4076-8482-2c4ca8343a26 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.info" returned: 0 in 0.640s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-349707a4-cf2b-4076-8482-2c4ca8343a26 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.525s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-215dd815-df3f-4d53-ba09-bcf3281a23e4 tempest-VolumesExtendTest-2140193734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 6.699s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:47 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-349707a4-cf2b-4076-8482-2c4ca8343a26 tempest-VolumesSnapshotTestJSON-1115347481 None] Create snapshot completed successfully Jul 10 00:33:47 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6a1a3e-ecde-45ad-a1be-315a4afb1887]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-215dd815-df3f-4d53-ba09-bcf3281a23e4 tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:47 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd Jul 10 00:33:47 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:48 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f2bfa06c-9337-42e4-bf9a-1a1daf35de00 tempest-VolumesSnapshotListTestJSON-477339393 None] Acquiring lock "cinder-8819791a-6990-40e3-9629-968047397bd9-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:48 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f2bfa06c-9337-42e4-bf9a-1a1daf35de00 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "cinder-8819791a-6990-40e3-9629-968047397bd9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:48 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f2bfa06c-9337-42e4-bf9a-1a1daf35de00 tempest-VolumesSnapshotListTestJSON-477339393 None] Acquiring lock "cinder-quobyte-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:48 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f2bfa06c-9337-42e4-bf9a-1a1daf35de00 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "cinder-quobyte-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:48 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f2bfa06c-9337-42e4-bf9a-1a1daf35de00 tempest-VolumesSnapshotListTestJSON-477339393 None] Acquiring lock "cinder-quobyte-8819791a-6990-40e3-9629-968047397bd9" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:48 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f2bfa06c-9337-42e4-bf9a-1a1daf35de00 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "cinder-quobyte-8819791a-6990-40e3-9629-968047397bd9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-f2bfa06c-9337-42e4-bf9a-1a1daf35de00 tempest-VolumesSnapshotListTestJSON-477339393 None] Deleting offline snapshot 8819791a-6990-40e3-9629-968047397bd9 of volume fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:33:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-f2bfa06c-9337-42e4-bf9a-1a1daf35de00 tempest-VolumesSnapshotListTestJSON-477339393 None] snapshot_file for this snap is: volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:33:48 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[94afc56b-38e9-401e-98ef-4870b81b04fb]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:48 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f2bfa06c-9337-42e4-bf9a-1a1daf35de00 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-215dd815-df3f-4d53-ba09-bcf3281a23e4 tempest-VolumesExtendTest-2140193734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd" returned: 0 in 0.811s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-215dd815-df3f-4d53-ba09-bcf3281a23e4 tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:48 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:33:48 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9 Jul 10 00:33:48 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Flow 'volume_create_manager' (c15f7376-6c5e-4176-9786-fbed06fb22e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:33:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb42c80-a1f7-45db-bc20-94dafd98e1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:48 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd Jul 10 00:33:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb42c80-a1f7-45db-bc20-94dafd98e1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1149717481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdfc72d0-7728-44ab-9557-3d61bcdb9270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a27e82cdaeb400cbc1dc5423ebb04a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:33:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=37c3059a-76c1-411c-99cb-17ba19fd2061,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:33:48Z,use_quota=True,user_id='91a89fc2310445f789b9cd98c4058f18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:48 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3413768-4e2d-46e8-9906-b2048a97b598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3413768-4e2d-46e8-9906-b2048a97b598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c38f4899-aece-47fe-b2c9-641507ff1b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c38f4899-aece-47fe-b2c9-641507ff1b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cdfc72d0-7728-44ab-9557-3d61bcdb9270', 'volume_name': 'volume-cdfc72d0-7728-44ab-9557-3d61bcdb9270', 'volume_size': 2, 'snapshot_id': '37c3059a-76c1-411c-99cb-17ba19fd2061'}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f7bb98-59a8-4667-ad68-a6775ed32b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f7bb98-59a8-4667-ad68-a6775ed32b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51c8b12f-ab18-428e-9d7f-ae7fb2f713ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:48 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Volume cdfc72d0-7728-44ab-9557-3d61bcdb9270: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cdfc72d0-7728-44ab-9557-3d61bcdb9270', 'volume_size': 2, 'snapshot_id': '37c3059a-76c1-411c-99cb-17ba19fd2061'} Jul 10 00:33:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:49 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f2bfa06c-9337-42e4-bf9a-1a1daf35de00 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9" returned: 0 in 0.812s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-f2bfa06c-9337-42e4-bf9a-1a1daf35de00 tempest-VolumesSnapshotListTestJSON-477339393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:33:49 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4bb600-c614-4de1-b14a-ffa1c6af5ad0]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f2bfa06c-9337-42e4-bf9a-1a1daf35de00 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:49 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-215dd815-df3f-4d53-ba09-bcf3281a23e4 tempest-VolumesExtendTest-2140193734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd" returned: 1 in 0.829s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-215dd815-df3f-4d53-ba09-bcf3281a23e4 tempest-VolumesExtendTest-2140193734 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:33:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-215dd815-df3f-4d53-ba09-bcf3281a23e4 tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd 2G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:49 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07 Jul 10 00:33:49 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-215dd815-df3f-4d53-ba09-bcf3281a23e4 tempest-VolumesExtendTest-2140193734 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd 2G" returned: 0 in 0.088s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-215dd815-df3f-4d53-ba09-bcf3281a23e4 tempest-VolumesExtendTest-2140193734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.777s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.848s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-925096569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13d36a3-d6c2-499f-bd0d-95a5f568df75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee5d8778838c4974ada006372cc34212',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:33:45Z,use_quota=True,user_id='3417d97f3a52415b908f2c977100b087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:33:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Creating volume f13d36a3-d6c2-499f-bd0d-95a5f568df75 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:33:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:33:49 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:33:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f13d36a3-d6c2-499f-bd0d-95a5f568df75 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:49 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f13d36a3-d6c2-499f-bd0d-95a5f568df75 1073741824 Jul 10 00:33:49 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:49 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-215dd815-df3f-4d53-ba09-bcf3281a23e4 tempest-VolumesExtendTest-2140193734 None] Extend volume completed successfully. Jul 10 00:33:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ba609ceb-2782-4523-8b4b-0477606683f6 tempest-VolumesExtendTest-2140193734 None] Acquiring lock "cinder-9309bd6b-983e-4a59-9739-fbe36c0008bd-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ba609ceb-2782-4523-8b4b-0477606683f6 tempest-VolumesExtendTest-2140193734 None] Lock "cinder-9309bd6b-983e-4a59-9739-fbe36c0008bd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ba609ceb-2782-4523-8b4b-0477606683f6 tempest-VolumesExtendTest-2140193734 None] Acquiring lock "cinder-quobyte-9309bd6b-983e-4a59-9739-fbe36c0008bd" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ba609ceb-2782-4523-8b4b-0477606683f6 tempest-VolumesExtendTest-2140193734 None] Lock "cinder-quobyte-9309bd6b-983e-4a59-9739-fbe36c0008bd" acquired by "delete_volume" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:49 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15c00e5-71bb-43c1-819b-7a4d552e3bcd]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ba609ceb-2782-4523-8b4b-0477606683f6 tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:50 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f2bfa06c-9337-42e4-bf9a-1a1daf35de00 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07" returned: 0 in 0.838s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-f2bfa06c-9337-42e4-bf9a-1a1daf35de00 tempest-VolumesSnapshotListTestJSON-477339393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f2bfa06c-9337-42e4-bf9a-1a1daf35de00 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:50 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9 Jul 10 00:33:50 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:50 devstack sudo[99197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd Jul 10 00:33:50 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:50 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f13d36a3-d6c2-499f-bd0d-95a5f568df75 1073741824" returned: 0 in 0.849s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f13d36a3-d6c2-499f-bd0d-95a5f568df75 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:50 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f13d36a3-d6c2-499f-bd0d-95a5f568df75 Jul 10 00:33:50 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:50 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ba609ceb-2782-4523-8b4b-0477606683f6 tempest-VolumesExtendTest-2140193734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd" returned: 0 in 0.827s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ba609ceb-2782-4523-8b4b-0477606683f6 tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:50 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f2bfa06c-9337-42e4-bf9a-1a1daf35de00 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9" returned: 0 in 0.824s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f2bfa06c-9337-42e4-bf9a-1a1daf35de00 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:50 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f13d36a3-d6c2-499f-bd0d-95a5f568df75" returned: 0 in 0.666s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:50 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9 Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:50 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.296s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "cinder-quobyte-37c3059a-76c1-411c-99cb-17ba19fd2061-cdfc72d0-7728-44ab-9557-3d61bcdb9270" by "_create_volume_from_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5868d23-0b84-4904-888b-9c6e86834ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f13d36a3-d6c2-499f-bd0d-95a5f568df75', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4396901d-f013-40df-b256-3ae0b197b9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-37c3059a-76c1-411c-99cb-17ba19fd2061-cdfc72d0-7728-44ab-9557-3d61bcdb9270" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Creating volume cdfc72d0-7728-44ab-9557-3d61bcdb9270 from snapshot 37c3059a-76c1-411c-99cb-17ba19fd2061 {{(pid=88119) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "cinder-quobyte-cdfc72d0-7728-44ab-9557-3d61bcdb9270" by "_copy_volume_from_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:50 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Volume volume-f13d36a3-d6c2-499f-bd0d-95a5f568df75 (f13d36a3-d6c2-499f-bd0d-95a5f568df75): created successfully Jul 10 00:33:50 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd Jul 10 00:33:50 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4396901d-f013-40df-b256-3ae0b197b9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Flow 'volume_create_manager' (5b3991c2-36d0-45ba-9cdb-3c5b63160bfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-cdfc72d0-7728-44ab-9557-3d61bcdb9270" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] snapshot: 37c3059a-76c1-411c-99cb-17ba19fd2061, volume: cdfc72d0-7728-44ab-9557-3d61bcdb9270, {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 00:33:50 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-9bb64154-b329-41fe-9bf5-f44dc7c4da8d tempest-VolumesMetadataTest-848480555 None] Created volume successfully. Jul 10 00:33:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:51 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46882a7-d7c8-4fc0-b9bb-2b4cb1ee458e]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.37c3059a-76c1-411c-99cb-17ba19fd2061 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:51 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.37c3059a-76c1-411c-99cb-17ba19fd2061 Jul 10 00:33:51 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:51 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f2bfa06c-9337-42e4-bf9a-1a1daf35de00 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.8819791a-6990-40e3-9629-968047397bd9" returned: 0 in 0.678s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:51 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f2bfa06c-9337-42e4-bf9a-1a1daf35de00 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "cinder-quobyte-8819791a-6990-40e3-9629-968047397bd9" released by "_delete_snapshot" :: held 3.267s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:51 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f2bfa06c-9337-42e4-bf9a-1a1daf35de00 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "cinder-quobyte-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d" released by "delete_snapshot" :: held 3.294s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:51 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ba609ceb-2782-4523-8b4b-0477606683f6 tempest-VolumesExtendTest-2140193734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd" returned: 1 in 0.770s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ba609ceb-2782-4523-8b4b-0477606683f6 tempest-VolumesExtendTest-2140193734 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:33:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ba609ceb-2782-4523-8b4b-0477606683f6 tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:51 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd Jul 10 00:33:51 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:51 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-f2bfa06c-9337-42e4-bf9a-1a1daf35de00 tempest-VolumesSnapshotListTestJSON-477339393 None] Created reservations ['fcb49e1f-b4cf-4f13-b957-892ed813db41', '5bc3897a-352b-4a84-8278-533a820c9f87', '37fa1eab-b6ff-46b0-ba59-f3722f255b74', '68e4938c-ae17-4142-bdce-d4c883e552b4'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:33:51 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-f2bfa06c-9337-42e4-bf9a-1a1daf35de00 tempest-VolumesSnapshotListTestJSON-477339393 None] Delete snapshot completed successfully. Jul 10 00:33:51 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f2bfa06c-9337-42e4-bf9a-1a1daf35de00 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "cinder-8819791a-6990-40e3-9629-968047397bd9-delete_snapshot" released by "delete_snapshot" :: held 3.467s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:51 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.37c3059a-76c1-411c-99cb-17ba19fd2061" returned: 0 in 0.819s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:33:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 00:33:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Creating direct copy from snapshot {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 00:33:51 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b116689-c24e-4034-9bb6-36cacdbd20c1]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:51 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be Jul 10 00:33:51 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:52 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ba609ceb-2782-4523-8b4b-0477606683f6 tempest-VolumesExtendTest-2140193734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9309bd6b-983e-4a59-9739-fbe36c0008bd" returned: 0 in 0.678s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ba609ceb-2782-4523-8b4b-0477606683f6 tempest-VolumesExtendTest-2140193734 None] Lock "cinder-quobyte-9309bd6b-983e-4a59-9739-fbe36c0008bd" released by "delete_volume" :: held 2.357s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-ba609ceb-2782-4523-8b4b-0477606683f6 tempest-VolumesExtendTest-2140193734 None] Created reservations ['cb8f93c8-d410-463f-b835-29a700cc7c32', 'de956924-f200-4e01-bef1-335d5ca8f962', '13ae8587-e34d-423d-a7ec-6523668e2719', '92421e23-6181-4af4-8443-f778b4dff090'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ba609ceb-2782-4523-8b4b-0477606683f6 tempest-VolumesExtendTest-2140193734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ba609ceb-2782-4523-8b4b-0477606683f6 tempest-VolumesExtendTest-2140193734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ba609ceb-2782-4523-8b4b-0477606683f6 tempest-VolumesExtendTest-2140193734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ba609ceb-2782-4523-8b4b-0477606683f6 tempest-VolumesExtendTest-2140193734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ba609ceb-2782-4523-8b4b-0477606683f6 tempest-VolumesExtendTest-2140193734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ba609ceb-2782-4523-8b4b-0477606683f6 tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:52 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:33:52 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f2ea8063-b106-449f-baf9-d77e35ec4636 tempest-VolumesSnapshotListTestJSON-477339393 None] Acquiring lock "cinder-778cd669-31eb-4b4f-8358-c8eaa25ffd07-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7919a244-03a7-43b3-8035-821ec902ad79 tempest-VolumesMetadataTest-848480555 None] Acquiring lock "cinder-f13d36a3-d6c2-499f-bd0d-95a5f568df75-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7919a244-03a7-43b3-8035-821ec902ad79 tempest-VolumesMetadataTest-848480555 None] Lock "cinder-f13d36a3-d6c2-499f-bd0d-95a5f568df75-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f2ea8063-b106-449f-baf9-d77e35ec4636 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "cinder-778cd669-31eb-4b4f-8358-c8eaa25ffd07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f2ea8063-b106-449f-baf9-d77e35ec4636 tempest-VolumesSnapshotListTestJSON-477339393 None] Acquiring lock "cinder-quobyte-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f2ea8063-b106-449f-baf9-d77e35ec4636 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "cinder-quobyte-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f2ea8063-b106-449f-baf9-d77e35ec4636 tempest-VolumesSnapshotListTestJSON-477339393 None] Acquiring lock "cinder-quobyte-778cd669-31eb-4b4f-8358-c8eaa25ffd07" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f2ea8063-b106-449f-baf9-d77e35ec4636 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "cinder-quobyte-778cd669-31eb-4b4f-8358-c8eaa25ffd07" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-f2ea8063-b106-449f-baf9-d77e35ec4636 tempest-VolumesSnapshotListTestJSON-477339393 None] Deleting offline snapshot 778cd669-31eb-4b4f-8358-c8eaa25ffd07 of volume fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-f2ea8063-b106-449f-baf9-d77e35ec4636 tempest-VolumesSnapshotListTestJSON-477339393 None] snapshot_file for this snap is: volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7919a244-03a7-43b3-8035-821ec902ad79 tempest-VolumesMetadataTest-848480555 None] Acquiring lock "cinder-quobyte-f13d36a3-d6c2-499f-bd0d-95a5f568df75" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[00054d48-c83d-44fc-99c1-0a6d56b8b4de]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f2ea8063-b106-449f-baf9-d77e35ec4636 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7919a244-03a7-43b3-8035-821ec902ad79 tempest-VolumesMetadataTest-848480555 None] Lock "cinder-quobyte-f13d36a3-d6c2-499f-bd0d-95a5f568df75" acquired by "delete_volume" :: waited 0.027s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b997fa5-b9de-41bb-b260-3d7a41e696c2]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7919a244-03a7-43b3-8035-821ec902ad79 tempest-VolumesMetadataTest-848480555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f13d36a3-d6c2-499f-bd0d-95a5f568df75 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:52 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07 Jul 10 00:33:52 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:52 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be" returned: 0 in 0.931s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG cinder.utils [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Path /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cdfc72d0-7728-44ab-9557-3d61bcdb9270 not found in is_blk_device check {{(pid=88119) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 00:33:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cdfc72d0-7728-44ab-9557-3d61bcdb9270 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:52 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f13d36a3-d6c2-499f-bd0d-95a5f568df75 Jul 10 00:33:52 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:52 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cdfc72d0-7728-44ab-9557-3d61bcdb9270 Jul 10 00:33:52 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:53 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ba609ceb-2782-4523-8b4b-0477606683f6 tempest-VolumesExtendTest-2140193734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.766s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:53 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-ba609ceb-2782-4523-8b4b-0477606683f6 tempest-VolumesExtendTest-2140193734 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:33:53 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-ba609ceb-2782-4523-8b4b-0477606683f6 tempest-VolumesExtendTest-2140193734 None] Deleted volume successfully. Jul 10 00:33:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ba609ceb-2782-4523-8b4b-0477606683f6 tempest-VolumesExtendTest-2140193734 None] Lock "cinder-9309bd6b-983e-4a59-9739-fbe36c0008bd-delete_volume" released by "delete_volume" :: held 3.392s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:53 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f2ea8063-b106-449f-baf9-d77e35ec4636 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07" returned: 0 in 0.836s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-f2ea8063-b106-449f-baf9-d77e35ec4636 tempest-VolumesSnapshotListTestJSON-477339393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:33:53 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d6f9e1-906c-4f74-a186-f49f1191d8c3]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f2ea8063-b106-449f-baf9-d77e35ec4636 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:53 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d Jul 10 00:33:53 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:53 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7919a244-03a7-43b3-8035-821ec902ad79 tempest-VolumesMetadataTest-848480555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f13d36a3-d6c2-499f-bd0d-95a5f568df75" returned: 0 in 1.028s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7919a244-03a7-43b3-8035-821ec902ad79 tempest-VolumesMetadataTest-848480555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f13d36a3-d6c2-499f-bd0d-95a5f568df75 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:53 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f13d36a3-d6c2-499f-bd0d-95a5f568df75 Jul 10 00:33:53 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:53 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:33:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Flow 'volume_create_manager' (69cf8522-5e58-4b5c-80d6-4fce9d6f0690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:33:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5b6e7c-26b4-4e8d-b921-fb74ec0fa884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5b6e7c-26b4-4e8d-b921-fb74ec0fa884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-339082087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82b29a1c-13ee-4a46-a759-c2605fcb3bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d321e5e13c4c29afad7f22092881ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:33:54Z,use_quota=True,user_id='6911e614d76045c9a73bcc57df6ee6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc271ccc-47d3-469c-a619-248696df070c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc271ccc-47d3-469c-a619-248696df070c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (487ffd3d-2575-429f-aa33-0701ae5fe614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (487ffd3d-2575-429f-aa33-0701ae5fe614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82b29a1c-13ee-4a46-a759-c2605fcb3bac', 'volume_name': 'volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd7e639-ba42-433b-9e34-9b8c56af23bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd7e639-ba42-433b-9e34-9b8c56af23bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:33:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9303e50f-096e-47fd-93cd-36fe9c65c011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:33:54 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Volume 82b29a1c-13ee-4a46-a759-c2605fcb3bac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac', 'volume_size': 1} Jul 10 00:33:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:54 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7919a244-03a7-43b3-8035-821ec902ad79 tempest-VolumesMetadataTest-848480555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f13d36a3-d6c2-499f-bd0d-95a5f568df75" returned: 0 in 1.219s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7919a244-03a7-43b3-8035-821ec902ad79 tempest-VolumesMetadataTest-848480555 None] Lock "cinder-quobyte-f13d36a3-d6c2-499f-bd0d-95a5f568df75" released by "delete_volume" :: held 2.315s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:55 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-7919a244-03a7-43b3-8035-821ec902ad79 tempest-VolumesMetadataTest-848480555 None] Created reservations ['b646e51c-d95e-48e2-94ac-ab77a0614155', '2f3c1840-e59a-4805-ae2a-cae9738dc3f3', '95e120b8-f195-4725-af72-987488eece5d', '3e78d16e-764e-4eff-94ce-6494fb751985'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:33:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7919a244-03a7-43b3-8035-821ec902ad79 tempest-VolumesMetadataTest-848480555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:33:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7919a244-03a7-43b3-8035-821ec902ad79 tempest-VolumesMetadataTest-848480555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:33:55 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7919a244-03a7-43b3-8035-821ec902ad79 tempest-VolumesMetadataTest-848480555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:33:55 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7919a244-03a7-43b3-8035-821ec902ad79 tempest-VolumesMetadataTest-848480555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:33:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7919a244-03a7-43b3-8035-821ec902ad79 tempest-VolumesMetadataTest-848480555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:33:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7919a244-03a7-43b3-8035-821ec902ad79 tempest-VolumesMetadataTest-848480555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:55 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:33:55 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:55 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f2ea8063-b106-449f-baf9-d77e35ec4636 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d" returned: 0 in 2.034s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f2ea8063-b106-449f-baf9-d77e35ec4636 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:55 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07 Jul 10 00:33:55 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:57 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:57 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f2ea8063-b106-449f-baf9-d77e35ec4636 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07" returned: 0 in 1.644s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f2ea8063-b106-449f-baf9-d77e35ec4636 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7919a244-03a7-43b3-8035-821ec902ad79 tempest-VolumesMetadataTest-848480555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.922s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:57 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-7919a244-03a7-43b3-8035-821ec902ad79 tempest-VolumesMetadataTest-848480555 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:33:57 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07 Jul 10 00:33:57 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-7919a244-03a7-43b3-8035-821ec902ad79 tempest-VolumesMetadataTest-848480555 None] Deleted volume successfully. Jul 10 00:33:57 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:57 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7919a244-03a7-43b3-8035-821ec902ad79 tempest-VolumesMetadataTest-848480555 None] Lock "cinder-f13d36a3-d6c2-499f-bd0d-95a5f568df75-delete_volume" released by "delete_volume" :: held 4.749s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:58 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f2ea8063-b106-449f-baf9-d77e35ec4636 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d.778cd669-31eb-4b4f-8358-c8eaa25ffd07" returned: 0 in 1.356s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:58 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f2ea8063-b106-449f-baf9-d77e35ec4636 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "cinder-quobyte-778cd669-31eb-4b4f-8358-c8eaa25ffd07" released by "_delete_snapshot" :: held 6.005s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:58 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f2ea8063-b106-449f-baf9-d77e35ec4636 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "cinder-quobyte-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d" released by "delete_snapshot" :: held 6.036s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:58 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-f2ea8063-b106-449f-baf9-d77e35ec4636 tempest-VolumesSnapshotListTestJSON-477339393 None] Created reservations ['23c38b0a-179f-438d-9f4c-9001cf558cc4', '70fc2f5f-4373-4bb9-a611-33534d3aa81c', '478dd898-2315-4f26-94b3-9b9a5674d4eb', 'b8c958b6-6d21-48f6-954d-2830de09cd79'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:33:58 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cdfc72d0-7728-44ab-9557-3d61bcdb9270" returned: 0 in 5.891s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:58 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[59208ced-2b7b-4753-a1f7-7b83111ff399]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:58 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-f2ea8063-b106-449f-baf9-d77e35ec4636 tempest-VolumesSnapshotListTestJSON-477339393 None] Delete snapshot completed successfully. Jul 10 00:33:58 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f2ea8063-b106-449f-baf9-d77e35ec4636 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "cinder-778cd669-31eb-4b4f-8358-c8eaa25ffd07-delete_snapshot" released by "delete_snapshot" :: held 6.230s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:33:58 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be Jul 10 00:33:58 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-dc50b10c-e248-4a39-906a-7b9e4dc2ddc1 tempest-VolumesSnapshotListTestJSON-477339393 None] Acquiring lock "cinder-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-dc50b10c-e248-4a39-906a-7b9e4dc2ddc1 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "cinder-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-dc50b10c-e248-4a39-906a-7b9e4dc2ddc1 tempest-VolumesSnapshotListTestJSON-477339393 None] Acquiring lock "cinder-quobyte-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:33:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-dc50b10c-e248-4a39-906a-7b9e4dc2ddc1 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "cinder-quobyte-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d" acquired by "delete_volume" :: waited 0.017s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:33:59 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f916f702-c25f-42ae-bb81-b8894f56e6d7]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:33:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dc50b10c-e248-4a39-906a-7b9e4dc2ddc1 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:59 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d Jul 10 00:33:59 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:33:59 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Jul 10 00:33:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be" returned: 0 in 1.081s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:33:59 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Image conversion details: src /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cdfc72d0-7728-44ab-9557-3d61bcdb9270 {{(pid=88119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:33:59 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Converted 1024.00 MB image at 173.79 MB/s Jul 10 00:33:59 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cdfc72d0-7728-44ab-9557-3d61bcdb9270 is being set with open permissions: ugo+rw Jul 10 00:33:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cdfc72d0-7728-44ab-9557-3d61bcdb9270 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:33:59 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cdfc72d0-7728-44ab-9557-3d61bcdb9270 Jul 10 00:33:59 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:00 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dc50b10c-e248-4a39-906a-7b9e4dc2ddc1 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d" returned: 0 in 0.855s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dc50b10c-e248-4a39-906a-7b9e4dc2ddc1 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:00 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d Jul 10 00:34:00 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:00 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cdfc72d0-7728-44ab-9557-3d61bcdb9270" returned: 0 in 0.734s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-cdfc72d0-7728-44ab-9557-3d61bcdb9270" released by "_copy_volume_from_snapshot" :: held 9.582s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-37c3059a-76c1-411c-99cb-17ba19fd2061-cdfc72d0-7728-44ab-9557-3d61bcdb9270" released by "_create_volume_from_snapshot" :: held 9.644s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.687s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.486s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-339082087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82b29a1c-13ee-4a46-a759-c2605fcb3bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d321e5e13c4c29afad7f22092881ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:33:54Z,use_quota=True,user_id='6911e614d76045c9a73bcc57df6ee6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Creating volume 82b29a1c-13ee-4a46-a759-c2605fcb3bac {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:34:00 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:00 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac 1073741824 Jul 10 00:34:00 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51c8b12f-ab18-428e-9d7f-ae7fb2f713ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdfc72d0-7728-44ab-9557-3d61bcdb9270', 'volume_size': 2, 'snapshot_id': '37c3059a-76c1-411c-99cb-17ba19fd2061'}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9495ad24-2148-4d33-a3aa-33e0c0d23597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:00 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Volume volume-cdfc72d0-7728-44ab-9557-3d61bcdb9270 (cdfc72d0-7728-44ab-9557-3d61bcdb9270): created successfully Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9495ad24-2148-4d33-a3aa-33e0c0d23597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Flow 'volume_create_manager' (c15f7376-6c5e-4176-9786-fbed06fb22e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:00 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-592e965c-8a80-4392-8f39-6c154ca2cbcd tempest-VolumesSnapshotTestJSON-1115347481 None] Created volume successfully. Jul 10 00:34:00 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dc50b10c-e248-4a39-906a-7b9e4dc2ddc1 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d" returned: 0 in 0.721s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-dc50b10c-e248-4a39-906a-7b9e4dc2ddc1 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "cinder-quobyte-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d" released by "delete_volume" :: held 1.643s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-dc50b10c-e248-4a39-906a-7b9e4dc2ddc1 tempest-VolumesSnapshotListTestJSON-477339393 None] Created reservations ['2e64cf0a-e9cf-44ce-b410-f600f8afab89', '64272a2a-db2a-4ea7-8ba9-bb0daf8f3f17', '2e246fe9-79b9-4862-980b-dd4c44392dc8', '68df869b-7b03-43ac-a12f-acd5b611cb1d'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dc50b10c-e248-4a39-906a-7b9e4dc2ddc1 tempest-VolumesSnapshotListTestJSON-477339393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dc50b10c-e248-4a39-906a-7b9e4dc2ddc1 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-dc50b10c-e248-4a39-906a-7b9e4dc2ddc1 tempest-VolumesSnapshotListTestJSON-477339393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-dc50b10c-e248-4a39-906a-7b9e4dc2ddc1 tempest-VolumesSnapshotListTestJSON-477339393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dc50b10c-e248-4a39-906a-7b9e4dc2ddc1 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dc50b10c-e248-4a39-906a-7b9e4dc2ddc1 tempest-VolumesSnapshotListTestJSON-477339393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:01 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:34:01 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:01 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac 1073741824" returned: 0 in 1.006s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:01 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac Jul 10 00:34:01 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:01 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dc50b10c-e248-4a39-906a-7b9e4dc2ddc1 tempest-VolumesSnapshotListTestJSON-477339393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.753s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:01 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-dc50b10c-e248-4a39-906a-7b9e4dc2ddc1 tempest-VolumesSnapshotListTestJSON-477339393 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:34:01 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-dc50b10c-e248-4a39-906a-7b9e4dc2ddc1 tempest-VolumesSnapshotListTestJSON-477339393 None] Deleted volume successfully. Jul 10 00:34:01 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-dc50b10c-e248-4a39-906a-7b9e4dc2ddc1 tempest-VolumesSnapshotListTestJSON-477339393 None] Lock "cinder-fb8e7a4f-ca0b-4c1c-b01c-bbe6ce53004d-delete_volume" released by "delete_volume" :: held 2.648s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:01 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-885f9497-f3fc-4e0b-857e-fef87e665278 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "cinder-cdfc72d0-7728-44ab-9557-3d61bcdb9270-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:01 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-885f9497-f3fc-4e0b-857e-fef87e665278 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-cdfc72d0-7728-44ab-9557-3d61bcdb9270-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:01 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-885f9497-f3fc-4e0b-857e-fef87e665278 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "cinder-quobyte-cdfc72d0-7728-44ab-9557-3d61bcdb9270" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:01 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-885f9497-f3fc-4e0b-857e-fef87e665278 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-cdfc72d0-7728-44ab-9557-3d61bcdb9270" acquired by "delete_volume" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:01 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9b3963-f27d-416c-bd63-ef6579356886]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-885f9497-f3fc-4e0b-857e-fef87e665278 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cdfc72d0-7728-44ab-9557-3d61bcdb9270 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:02 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cdfc72d0-7728-44ab-9557-3d61bcdb9270 Jul 10 00:34:02 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Flow 'volume_create_manager' (7b7b4b1a-4ad8-4798-b03b-761e2f0abf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ead0923a-c7be-4f71-8fe1-b54062188983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:02 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac" returned: 0 in 0.890s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ead0923a-c7be-4f71-8fe1-b54062188983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-466165963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=927c4a0d-109d-47dd-b825-9166ca079049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13f1f3ee2244547afa5ab56a7c93157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:02Z,use_quota=True,user_id='53a569def93748b481fd80d62ce0efc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d018f36d-8c0d-4d64-a0b5-ab38d1e50fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d018f36d-8c0d-4d64-a0b5-ab38d1e50fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5146772c-d2b9-499b-a6e2-7268bf6fa739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5146772c-d2b9-499b-a6e2-7268bf6fa739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '927c4a0d-109d-47dd-b825-9166ca079049', 'volume_name': 'volume-927c4a0d-109d-47dd-b825-9166ca079049', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74708a6d-882c-482a-bc95-0af37471ed0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74708a6d-882c-482a-bc95-0af37471ed0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4ef9c4-38ef-4950-8e53-5b775fd4aba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:02 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Volume 927c4a0d-109d-47dd-b825-9166ca079049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-927c4a0d-109d-47dd-b825-9166ca079049', 'volume_size': 1} Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-466165963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=927c4a0d-109d-47dd-b825-9166ca079049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13f1f3ee2244547afa5ab56a7c93157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:02Z,use_quota=True,user_id='53a569def93748b481fd80d62ce0efc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Creating volume 927c4a0d-109d-47dd-b825-9166ca079049 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:34:02 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-927c4a0d-109d-47dd-b825-9166ca079049 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9303e50f-096e-47fd-93cd-36fe9c65c011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:02 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-927c4a0d-109d-47dd-b825-9166ca079049 1073741824 Jul 10 00:34:02 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e926e9-e32a-4310-86c1-5b60f2002e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:02 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Volume volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac (82b29a1c-13ee-4a46-a759-c2605fcb3bac): created successfully Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e926e9-e32a-4310-86c1-5b60f2002e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Flow 'volume_create_manager' (69cf8522-5e58-4b5c-80d6-4fce9d6f0690) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:02 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-032d9d32-f1fa-45fd-8362-229889c7bd4a tempest-VolumesExtendTest-2140193734 None] Created volume successfully. Jul 10 00:34:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c673c339-0fb4-4047-8251-e3c658b4ba9e tempest-VolumesExtendTest-2140193734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:03 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-885f9497-f3fc-4e0b-857e-fef87e665278 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cdfc72d0-7728-44ab-9557-3d61bcdb9270" returned: 0 in 1.178s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-885f9497-f3fc-4e0b-857e-fef87e665278 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cdfc72d0-7728-44ab-9557-3d61bcdb9270 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:03 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cdfc72d0-7728-44ab-9557-3d61bcdb9270 Jul 10 00:34:03 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:03 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-927c4a0d-109d-47dd-b825-9166ca079049 1073741824" returned: 0 in 1.107s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-927c4a0d-109d-47dd-b825-9166ca079049 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:03 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-927c4a0d-109d-47dd-b825-9166ca079049 Jul 10 00:34:03 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:03 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-885f9497-f3fc-4e0b-857e-fef87e665278 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cdfc72d0-7728-44ab-9557-3d61bcdb9270" returned: 0 in 0.701s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:03 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-885f9497-f3fc-4e0b-857e-fef87e665278 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-cdfc72d0-7728-44ab-9557-3d61bcdb9270" released by "delete_volume" :: held 1.940s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:03 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-885f9497-f3fc-4e0b-857e-fef87e665278 tempest-VolumesSnapshotTestJSON-1115347481 None] Created reservations ['89479a5e-bbfe-413d-9c2c-adab238f1a0a', '44eb8aa9-56f3-40b6-a8c6-c786cea5063f', '2417375f-205d-4162-b99c-544dc96a5ea5', 'ea54a646-c26e-488d-9d48-3e79f462ef24'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-885f9497-f3fc-4e0b-857e-fef87e665278 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-885f9497-f3fc-4e0b-857e-fef87e665278 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-885f9497-f3fc-4e0b-857e-fef87e665278 tempest-VolumesSnapshotTestJSON-1115347481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-885f9497-f3fc-4e0b-857e-fef87e665278 tempest-VolumesSnapshotTestJSON-1115347481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-885f9497-f3fc-4e0b-857e-fef87e665278 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-885f9497-f3fc-4e0b-857e-fef87e665278 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:04 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:34:04 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-df4b060f-a3fe-4a8d-8810-db82cb5c8049 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "cinder-37c3059a-76c1-411c-99cb-17ba19fd2061-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-df4b060f-a3fe-4a8d-8810-db82cb5c8049 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-37c3059a-76c1-411c-99cb-17ba19fd2061-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-df4b060f-a3fe-4a8d-8810-db82cb5c8049 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "cinder-quobyte-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-df4b060f-a3fe-4a8d-8810-db82cb5c8049 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-df4b060f-a3fe-4a8d-8810-db82cb5c8049 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "cinder-quobyte-37c3059a-76c1-411c-99cb-17ba19fd2061" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-df4b060f-a3fe-4a8d-8810-db82cb5c8049 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-37c3059a-76c1-411c-99cb-17ba19fd2061" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-df4b060f-a3fe-4a8d-8810-db82cb5c8049 tempest-VolumesSnapshotTestJSON-1115347481 None] Deleting offline snapshot 37c3059a-76c1-411c-99cb-17ba19fd2061 of volume 84a9d67b-2ae2-4166-a5e6-f1abd6fd28be {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-df4b060f-a3fe-4a8d-8810-db82cb5c8049 tempest-VolumesSnapshotTestJSON-1115347481 None] snapshot_file for this snap is: volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.37c3059a-76c1-411c-99cb-17ba19fd2061 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ae10f8-2c4d-4ac5-b6c2-4c354b66fccd]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-df4b060f-a3fe-4a8d-8810-db82cb5c8049 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.37c3059a-76c1-411c-99cb-17ba19fd2061 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:04 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.37c3059a-76c1-411c-99cb-17ba19fd2061 Jul 10 00:34:04 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:04 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-927c4a0d-109d-47dd-b825-9166ca079049" returned: 0 in 0.805s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] <== create_volume: return (1959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.962s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c673c339-0fb4-4047-8251-e3c658b4ba9e tempest-VolumesExtendTest-2140193734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.467s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4ef9c4-38ef-4950-8e53-5b775fd4aba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-927c4a0d-109d-47dd-b825-9166ca079049', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e75b00d-1847-4a21-b03d-818e8f274d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-c673c339-0fb4-4047-8251-e3c658b4ba9e tempest-VolumesExtendTest-2140193734 None] Creating offline snapshot 94dc690c-6a33-4d21-bb3b-71bcfa757139 of volume 82b29a1c-13ee-4a46-a759-c2605fcb3bac {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:34:04 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Volume volume-927c4a0d-109d-47dd-b825-9166ca079049 (927c4a0d-109d-47dd-b825-9166ca079049): created successfully Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e75b00d-1847-4a21-b03d-818e8f274d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Flow 'volume_create_manager' (7b7b4b1a-4ad8-4798-b03b-761e2f0abf67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9910735-06f2-4a56-be9e-7e9a6d3c0e89]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c673c339-0fb4-4047-8251-e3c658b4ba9e tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:04 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-7eddc8eb-9fca-4587-9352-b06b9defca5b tempest-VolumesTransfersTest-1842383916 None] Created volume successfully. Jul 10 00:34:04 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:04 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-885f9497-f3fc-4e0b-857e-fef87e665278 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.777s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:04 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-885f9497-f3fc-4e0b-857e-fef87e665278 tempest-VolumesSnapshotTestJSON-1115347481 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:34:04 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-885f9497-f3fc-4e0b-857e-fef87e665278 tempest-VolumesSnapshotTestJSON-1115347481 None] Deleted volume successfully. Jul 10 00:34:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-885f9497-f3fc-4e0b-857e-fef87e665278 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-cdfc72d0-7728-44ab-9557-3d61bcdb9270-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:05 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-df4b060f-a3fe-4a8d-8810-db82cb5c8049 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.37c3059a-76c1-411c-99cb-17ba19fd2061" returned: 0 in 0.980s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-df4b060f-a3fe-4a8d-8810-db82cb5c8049 tempest-VolumesSnapshotTestJSON-1115347481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:34:05 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c31fb6-cac8-44f8-813c-c663a81999fc]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-df4b060f-a3fe-4a8d-8810-db82cb5c8049 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:05 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be Jul 10 00:34:05 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:05 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c673c339-0fb4-4047-8251-e3c658b4ba9e tempest-VolumesExtendTest-2140193734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac" returned: 0 in 1.027s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c673c339-0fb4-4047-8251-e3c658b4ba9e tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.94dc690c-6a33-4d21-bb3b-71bcfa757139 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:05 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.94dc690c-6a33-4d21-bb3b-71bcfa757139 1G Jul 10 00:34:05 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:06 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-df4b060f-a3fe-4a8d-8810-db82cb5c8049 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be" returned: 0 in 1.027s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-df4b060f-a3fe-4a8d-8810-db82cb5c8049 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.37c3059a-76c1-411c-99cb-17ba19fd2061 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:06 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.37c3059a-76c1-411c-99cb-17ba19fd2061 Jul 10 00:34:06 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:06 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-ddc88de9-44ea-4fe8-b104-1e214fc8dfae tempest-VolumesTransfersTest-1442755755 None] Transfer volume completed successfully. Jul 10 00:34:06 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c673c339-0fb4-4047-8251-e3c658b4ba9e tempest-VolumesExtendTest-2140193734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.94dc690c-6a33-4d21-bb3b-71bcfa757139 1G" returned: 0 in 1.166s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c673c339-0fb4-4047-8251-e3c658b4ba9e tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.94dc690c-6a33-4d21-bb3b-71bcfa757139 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:06 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.94dc690c-6a33-4d21-bb3b-71bcfa757139 Jul 10 00:34:06 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:07 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-df4b060f-a3fe-4a8d-8810-db82cb5c8049 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.37c3059a-76c1-411c-99cb-17ba19fd2061" returned: 0 in 0.953s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-df4b060f-a3fe-4a8d-8810-db82cb5c8049 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.37c3059a-76c1-411c-99cb-17ba19fd2061 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:07 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.37c3059a-76c1-411c-99cb-17ba19fd2061 Jul 10 00:34:07 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-41cd75da-9058-47ca-a59e-c01323fb7559 tempest-VolumesTransfersTest-113664932 None] Acquiring lock "cinder-927c4a0d-109d-47dd-b825-9166ca079049-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-41cd75da-9058-47ca-a59e-c01323fb7559 tempest-VolumesTransfersTest-113664932 None] Lock "cinder-927c4a0d-109d-47dd-b825-9166ca079049-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:07 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c673c339-0fb4-4047-8251-e3c658b4ba9e tempest-VolumesExtendTest-2140193734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.94dc690c-6a33-4d21-bb3b-71bcfa757139" returned: 0 in 0.946s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:07 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-c673c339-0fb4-4047-8251-e3c658b4ba9e tempest-VolumesExtendTest-2140193734 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.94dc690c-6a33-4d21-bb3b-71bcfa757139 is being set with open permissions: ugo+rw Jul 10 00:34:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c673c339-0fb4-4047-8251-e3c658b4ba9e tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.94dc690c-6a33-4d21-bb3b-71bcfa757139 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:07 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.94dc690c-6a33-4d21-bb3b-71bcfa757139 Jul 10 00:34:07 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-41cd75da-9058-47ca-a59e-c01323fb7559 tempest-VolumesTransfersTest-113664932 None] Acquiring lock "cinder-quobyte-927c4a0d-109d-47dd-b825-9166ca079049" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-41cd75da-9058-47ca-a59e-c01323fb7559 tempest-VolumesTransfersTest-113664932 None] Lock "cinder-quobyte-927c4a0d-109d-47dd-b825-9166ca079049" acquired by "delete_volume" :: waited 0.022s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:07 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5888b91e-3619-465d-9e50-02eb70e67b1f]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-41cd75da-9058-47ca-a59e-c01323fb7559 tempest-VolumesTransfersTest-113664932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-927c4a0d-109d-47dd-b825-9166ca079049 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:08 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-927c4a0d-109d-47dd-b825-9166ca079049 Jul 10 00:34:08 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:08 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-df4b060f-a3fe-4a8d-8810-db82cb5c8049 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be.37c3059a-76c1-411c-99cb-17ba19fd2061" returned: 0 in 0.836s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-df4b060f-a3fe-4a8d-8810-db82cb5c8049 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-37c3059a-76c1-411c-99cb-17ba19fd2061" released by "_delete_snapshot" :: held 3.934s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-df4b060f-a3fe-4a8d-8810-db82cb5c8049 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be" released by "delete_snapshot" :: held 3.964s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:08 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-df4b060f-a3fe-4a8d-8810-db82cb5c8049 tempest-VolumesSnapshotTestJSON-1115347481 None] Created reservations ['2eab8053-12ff-4513-b6da-0807a1e29e8b', 'de7cc1d5-2ec0-4a1e-810e-f6d4d6c9ea4d', '6b6c23dc-1165-43ca-ab25-eccebff9a836', 'bf6e56ad-3b5c-474e-b948-a20b94cd564f'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:34:08 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-df4b060f-a3fe-4a8d-8810-db82cb5c8049 tempest-VolumesSnapshotTestJSON-1115347481 None] Delete snapshot completed successfully. Jul 10 00:34:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-df4b060f-a3fe-4a8d-8810-db82cb5c8049 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-37c3059a-76c1-411c-99cb-17ba19fd2061-delete_snapshot" released by "delete_snapshot" :: held 4.129s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-786da970-2254-4221-a836-b10dfcb98076 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "cinder-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-786da970-2254-4221-a836-b10dfcb98076 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-786da970-2254-4221-a836-b10dfcb98076 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "cinder-quobyte-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-786da970-2254-4221-a836-b10dfcb98076 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be" acquired by "delete_volume" :: waited 0.033s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:08 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c673c339-0fb4-4047-8251-e3c658b4ba9e tempest-VolumesExtendTest-2140193734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.94dc690c-6a33-4d21-bb3b-71bcfa757139" returned: 0 in 0.969s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:08 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e0d4bb-5833-439d-be96-e6f72ead4111]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-786da970-2254-4221-a836-b10dfcb98076 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c673c339-0fb4-4047-8251-e3c658b4ba9e tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:08 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-41cd75da-9058-47ca-a59e-c01323fb7559 tempest-VolumesTransfersTest-113664932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-927c4a0d-109d-47dd-b825-9166ca079049" returned: 0 in 0.918s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-41cd75da-9058-47ca-a59e-c01323fb7559 tempest-VolumesTransfersTest-113664932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-927c4a0d-109d-47dd-b825-9166ca079049 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:08 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.info Jul 10 00:34:08 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:08 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-927c4a0d-109d-47dd-b825-9166ca079049 Jul 10 00:34:08 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:08 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be Jul 10 00:34:08 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:09 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:09 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-786da970-2254-4221-a836-b10dfcb98076 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be" returned: 0 in 0.999s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-786da970-2254-4221-a836-b10dfcb98076 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c673c339-0fb4-4047-8251-e3c658b4ba9e tempest-VolumesExtendTest-2140193734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.info" returned: 0 in 0.973s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:09 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-c673c339-0fb4-4047-8251-e3c658b4ba9e tempest-VolumesExtendTest-2140193734 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.info is being set with open permissions: ugo+rw Jul 10 00:34:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c673c339-0fb4-4047-8251-e3c658b4ba9e tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:09 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be Jul 10 00:34:09 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:09 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-41cd75da-9058-47ca-a59e-c01323fb7559 tempest-VolumesTransfersTest-113664932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-927c4a0d-109d-47dd-b825-9166ca079049" returned: 0 in 0.984s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:09 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.info Jul 10 00:34:09 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:09 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-41cd75da-9058-47ca-a59e-c01323fb7559 tempest-VolumesTransfersTest-113664932 None] Lock "cinder-quobyte-927c4a0d-109d-47dd-b825-9166ca079049" released by "delete_volume" :: held 1.951s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:09 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-41cd75da-9058-47ca-a59e-c01323fb7559 tempest-VolumesTransfersTest-113664932 None] Created reservations ['0263c685-55dc-4600-b917-bd80943649a5', '2ccaab8e-17d4-4897-abd3-2494acfefb80', 'b467661d-8bc9-40b3-bc32-07fd7710dbcb', '9c6a5c00-14bc-4e25-9975-134fbb2e624e'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:34:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-41cd75da-9058-47ca-a59e-c01323fb7559 tempest-VolumesTransfersTest-113664932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-41cd75da-9058-47ca-a59e-c01323fb7559 tempest-VolumesTransfersTest-113664932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:09 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-41cd75da-9058-47ca-a59e-c01323fb7559 tempest-VolumesTransfersTest-113664932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:10 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-41cd75da-9058-47ca-a59e-c01323fb7559 tempest-VolumesTransfersTest-113664932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-41cd75da-9058-47ca-a59e-c01323fb7559 tempest-VolumesTransfersTest-113664932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-41cd75da-9058-47ca-a59e-c01323fb7559 tempest-VolumesTransfersTest-113664932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:10 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:34:10 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:10 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c673c339-0fb4-4047-8251-e3c658b4ba9e tempest-VolumesExtendTest-2140193734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.info" returned: 0 in 0.946s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c673c339-0fb4-4047-8251-e3c658b4ba9e tempest-VolumesExtendTest-2140193734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.193s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:10 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-c673c339-0fb4-4047-8251-e3c658b4ba9e tempest-VolumesExtendTest-2140193734 None] Create snapshot completed successfully Jul 10 00:34:10 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:34:10 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Flow 'volume_create_manager' (f5971089-3770-459a-b3a3-1e13c3cdef04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:10 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43046a39-12f6-497f-8950-4f60bf49c437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:10 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43046a39-12f6-497f-8950-4f60bf49c437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2099106414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cb8801b-5f52-44bb-9763-83a808826427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13f1f3ee2244547afa5ab56a7c93157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:11Z,use_quota=True,user_id='53a569def93748b481fd80d62ce0efc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:10 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8512bed-3f07-44e5-954c-725bd73d8d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:10 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8512bed-3f07-44e5-954c-725bd73d8d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:10 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a845ebcd-ee88-4fd5-ad34-fc7c314a53e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:10 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a845ebcd-ee88-4fd5-ad34-fc7c314a53e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cb8801b-5f52-44bb-9763-83a808826427', 'volume_name': 'volume-4cb8801b-5f52-44bb-9763-83a808826427', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:10 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd09363c-cd9d-4a8c-b70c-ef88ab0b17d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:11 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd09363c-cd9d-4a8c-b70c-ef88ab0b17d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:11 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a40548-eae3-4a14-9148-5a48699c4822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:11 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Volume 4cb8801b-5f52-44bb-9763-83a808826427: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cb8801b-5f52-44bb-9763-83a808826427', 'volume_size': 1} Jul 10 00:34:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2099106414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cb8801b-5f52-44bb-9763-83a808826427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13f1f3ee2244547afa5ab56a7c93157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:11Z,use_quota=True,user_id='53a569def93748b481fd80d62ce0efc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:34:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Creating volume 4cb8801b-5f52-44bb-9763-83a808826427 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:34:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:34:11 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:34:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4cb8801b-5f52-44bb-9763-83a808826427 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:11 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-786da970-2254-4221-a836-b10dfcb98076 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be" returned: 0 in 1.306s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:11 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4cb8801b-5f52-44bb-9763-83a808826427 1073741824 Jul 10 00:34:11 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-786da970-2254-4221-a836-b10dfcb98076 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be" released by "delete_volume" :: held 2.418s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:11 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-41cd75da-9058-47ca-a59e-c01323fb7559 tempest-VolumesTransfersTest-113664932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.134s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:11 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-41cd75da-9058-47ca-a59e-c01323fb7559 tempest-VolumesTransfersTest-113664932 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:34:11 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-41cd75da-9058-47ca-a59e-c01323fb7559 tempest-VolumesTransfersTest-113664932 None] Deleted volume successfully. Jul 10 00:34:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-41cd75da-9058-47ca-a59e-c01323fb7559 tempest-VolumesTransfersTest-113664932 None] Lock "cinder-927c4a0d-109d-47dd-b825-9166ca079049-delete_volume" released by "delete_volume" :: held 3.438s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:11 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-786da970-2254-4221-a836-b10dfcb98076 tempest-VolumesSnapshotTestJSON-1115347481 None] Created reservations ['474b7036-c14b-420a-9b45-4feb0be873f4', '9ba5f564-7b28-4270-8fe7-e8f7958859d4', '1565206f-1051-4fc4-99cb-22e589c76747', 'f1ec1391-c16d-428a-bd98-e75bb83dcd97'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:34:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-786da970-2254-4221-a836-b10dfcb98076 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-786da970-2254-4221-a836-b10dfcb98076 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-786da970-2254-4221-a836-b10dfcb98076 tempest-VolumesSnapshotTestJSON-1115347481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-786da970-2254-4221-a836-b10dfcb98076 tempest-VolumesSnapshotTestJSON-1115347481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-786da970-2254-4221-a836-b10dfcb98076 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-786da970-2254-4221-a836-b10dfcb98076 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:11 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:34:11 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1a8a5aff-45e2-4092-890a-0b0342d3c235 tempest-VolumesExtendTest-2140193734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:12 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4cb8801b-5f52-44bb-9763-83a808826427 1073741824" returned: 0 in 1.209s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:12 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:UPDATE=154,cinder:SELECT=140,cinder:DELETE=13,cinder:INSERT=54 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:34:12 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=137,cinder:UPDATE=155,cinder:INSERT=45,cinder:DELETE=13 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:34:12 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-786da970-2254-4221-a836-b10dfcb98076 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.866s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:12 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-786da970-2254-4221-a836-b10dfcb98076 tempest-VolumesSnapshotTestJSON-1115347481 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:34:12 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-786da970-2254-4221-a836-b10dfcb98076 tempest-VolumesSnapshotTestJSON-1115347481 None] Deleted volume successfully. Jul 10 00:34:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4cb8801b-5f52-44bb-9763-83a808826427 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:12 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-786da970-2254-4221-a836-b10dfcb98076 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-84a9d67b-2ae2-4166-a5e6-f1abd6fd28be-delete_volume" released by "delete_volume" :: held 3.735s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:12 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4cb8801b-5f52-44bb-9763-83a808826427 Jul 10 00:34:12 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:12 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:34:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Flow 'volume_create_manager' (7e363d71-50ca-41bd-955b-380ec4aff557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a823f7f-3747-49e7-973b-6001b24ddcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a823f7f-3747-49e7-973b-6001b24ddcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-53766444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a27e82cdaeb400cbc1dc5423ebb04a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:13Z,use_quota=True,user_id='91a89fc2310445f789b9cd98c4058f18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb958597-9c25-41b3-a656-ec6bdb1eb13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb958597-9c25-41b3-a656-ec6bdb1eb13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d768c6f8-ebbe-471b-9d05-97354bd209c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d768c6f8-ebbe-471b-9d05-97354bd209c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6', 'volume_name': 'volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c96139-e347-41d6-ad6a-3e83883e8fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3c96139-e347-41d6-ad6a-3e83883e8fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (231a7ba4-8b9f-4098-86c1-db733c3c61cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:12 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Volume 2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6', 'volume_size': 1} Jul 10 00:34:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:13 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4cb8801b-5f52-44bb-9763-83a808826427" returned: 0 in 0.804s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] <== create_volume: return (2107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:34:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.110s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1a8a5aff-45e2-4092-890a-0b0342d3c235 tempest-VolumesExtendTest-2140193734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.389s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a40548-eae3-4a14-9148-5a48699c4822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cb8801b-5f52-44bb-9763-83a808826427', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53970e39-17dc-4df8-a65f-2a79f4da7b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:13 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[bece0ddf-6954-41b9-bd2e-17f166cf65d9]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1a8a5aff-45e2-4092-890a-0b0342d3c235 tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:13 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Volume volume-4cb8801b-5f52-44bb-9763-83a808826427 (4cb8801b-5f52-44bb-9763-83a808826427): created successfully Jul 10 00:34:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53970e39-17dc-4df8-a65f-2a79f4da7b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Flow 'volume_create_manager' (f5971089-3770-459a-b3a3-1e13c3cdef04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:13 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-7d79d267-852d-4376-9f53-46a48e91d40d tempest-VolumesTransfersTest-1842383916 None] Created volume successfully. Jul 10 00:34:13 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac Jul 10 00:34:13 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:14 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1a8a5aff-45e2-4092-890a-0b0342d3c235 tempest-VolumesExtendTest-2140193734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac" returned: 0 in 0.858s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1a8a5aff-45e2-4092-890a-0b0342d3c235 tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.94dc690c-6a33-4d21-bb3b-71bcfa757139 2G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1a8a5aff-45e2-4092-890a-0b0342d3c235 tempest-VolumesExtendTest-2140193734 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.94dc690c-6a33-4d21-bb3b-71bcfa757139 2G" returned: 0 in 0.215s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1a8a5aff-45e2-4092-890a-0b0342d3c235 tempest-VolumesExtendTest-2140193734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.133s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.426s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-53766444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a27e82cdaeb400cbc1dc5423ebb04a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:13Z,use_quota=True,user_id='91a89fc2310445f789b9cd98c4058f18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:34:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Creating volume 2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:34:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:34:14 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:34:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:14 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 1073741824 Jul 10 00:34:14 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:14 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-1a8a5aff-45e2-4092-890a-0b0342d3c235 tempest-VolumesExtendTest-2140193734 None] Extend volume completed successfully. Jul 10 00:34:14 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e6f0daf5-be2b-4f6d-9863-92b0d2a840d5 tempest-VolumesTransfersTest-113664932 None] Acquiring lock "cinder-4cb8801b-5f52-44bb-9763-83a808826427-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:14 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e6f0daf5-be2b-4f6d-9863-92b0d2a840d5 tempest-VolumesTransfersTest-113664932 None] Lock "cinder-4cb8801b-5f52-44bb-9763-83a808826427-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:14 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e6f0daf5-be2b-4f6d-9863-92b0d2a840d5 tempest-VolumesTransfersTest-113664932 None] Acquiring lock "cinder-quobyte-4cb8801b-5f52-44bb-9763-83a808826427" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:14 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e6f0daf5-be2b-4f6d-9863-92b0d2a840d5 tempest-VolumesTransfersTest-113664932 None] Lock "cinder-quobyte-4cb8801b-5f52-44bb-9763-83a808826427" acquired by "delete_volume" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:14 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6eeaab4-2df5-47fd-8f2b-5a569f1a0a74]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e6f0daf5-be2b-4f6d-9863-92b0d2a840d5 tempest-VolumesTransfersTest-113664932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4cb8801b-5f52-44bb-9763-83a808826427 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:14 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4cb8801b-5f52-44bb-9763-83a808826427 Jul 10 00:34:14 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-43baf1fa-a59c-4ae1-8422-cafc3dc6b97e tempest-VolumesExtendTest-2140193734 None] Acquiring lock "cinder-94dc690c-6a33-4d21-bb3b-71bcfa757139-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-43baf1fa-a59c-4ae1-8422-cafc3dc6b97e tempest-VolumesExtendTest-2140193734 None] Lock "cinder-94dc690c-6a33-4d21-bb3b-71bcfa757139-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-43baf1fa-a59c-4ae1-8422-cafc3dc6b97e tempest-VolumesExtendTest-2140193734 None] Acquiring lock "cinder-quobyte-82b29a1c-13ee-4a46-a759-c2605fcb3bac" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-43baf1fa-a59c-4ae1-8422-cafc3dc6b97e tempest-VolumesExtendTest-2140193734 None] Lock "cinder-quobyte-82b29a1c-13ee-4a46-a759-c2605fcb3bac" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-43baf1fa-a59c-4ae1-8422-cafc3dc6b97e tempest-VolumesExtendTest-2140193734 None] Acquiring lock "cinder-quobyte-94dc690c-6a33-4d21-bb3b-71bcfa757139" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-43baf1fa-a59c-4ae1-8422-cafc3dc6b97e tempest-VolumesExtendTest-2140193734 None] Lock "cinder-quobyte-94dc690c-6a33-4d21-bb3b-71bcfa757139" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:15 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-43baf1fa-a59c-4ae1-8422-cafc3dc6b97e tempest-VolumesExtendTest-2140193734 None] Deleting offline snapshot 94dc690c-6a33-4d21-bb3b-71bcfa757139 of volume 82b29a1c-13ee-4a46-a759-c2605fcb3bac {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:34:15 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-43baf1fa-a59c-4ae1-8422-cafc3dc6b97e tempest-VolumesExtendTest-2140193734 None] snapshot_file for this snap is: volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.94dc690c-6a33-4d21-bb3b-71bcfa757139 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:34:15 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[687f850f-9fa3-446e-9aa1-f1a1d96598b7]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-43baf1fa-a59c-4ae1-8422-cafc3dc6b97e tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.94dc690c-6a33-4d21-bb3b-71bcfa757139 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:15 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.94dc690c-6a33-4d21-bb3b-71bcfa757139 Jul 10 00:34:15 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:15 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 1073741824" returned: 0 in 1.155s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:15 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 Jul 10 00:34:15 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:15 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e6f0daf5-be2b-4f6d-9863-92b0d2a840d5 tempest-VolumesTransfersTest-113664932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4cb8801b-5f52-44bb-9763-83a808826427" returned: 0 in 0.916s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e6f0daf5-be2b-4f6d-9863-92b0d2a840d5 tempest-VolumesTransfersTest-113664932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4cb8801b-5f52-44bb-9763-83a808826427 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:15 devstack sudo[99427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4cb8801b-5f52-44bb-9763-83a808826427 Jul 10 00:34:15 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:16 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6" returned: 0 in 0.790s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:16 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] <== create_volume: return (2013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:34:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.017s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (231a7ba4-8b9f-4098-86c1-db733c3c61cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2229c986-b8e2-43d7-9ea9-6ade2b75e11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:16 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Volume volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 (2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6): created successfully Jul 10 00:34:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2229c986-b8e2-43d7-9ea9-6ade2b75e11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Flow 'volume_create_manager' (7e363d71-50ca-41bd-955b-380ec4aff557) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:16 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-c52d212a-9439-4f13-a980-28e6fb446dd4 tempest-VolumesSnapshotTestJSON-1115347481 None] Created volume successfully. Jul 10 00:34:16 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:16 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e6f0daf5-be2b-4f6d-9863-92b0d2a840d5 tempest-VolumesTransfersTest-113664932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4cb8801b-5f52-44bb-9763-83a808826427" returned: 0 in 0.843s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-43baf1fa-a59c-4ae1-8422-cafc3dc6b97e tempest-VolumesExtendTest-2140193734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.94dc690c-6a33-4d21-bb3b-71bcfa757139" returned: 0 in 1.152s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:16 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-43baf1fa-a59c-4ae1-8422-cafc3dc6b97e tempest-VolumesExtendTest-2140193734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:34:16 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e6f0daf5-be2b-4f6d-9863-92b0d2a840d5 tempest-VolumesTransfersTest-113664932 None] Lock "cinder-quobyte-4cb8801b-5f52-44bb-9763-83a808826427" released by "delete_volume" :: held 1.833s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:16 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afa5502-85c8-47a8-abaf-6d6089c106f2]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-43baf1fa-a59c-4ae1-8422-cafc3dc6b97e tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:16 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-e6f0daf5-be2b-4f6d-9863-92b0d2a840d5 tempest-VolumesTransfersTest-113664932 None] Created reservations ['b6478bf4-ceca-460d-8a1e-59b55db2fc09', '1102708c-5594-4633-ba23-5e45aba6b97d', 'af52e226-a115-4e8b-af62-3213ef05026e', '2d03e6de-2019-4ad5-9db7-518033f0abdd'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:34:16 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac Jul 10 00:34:16 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e6f0daf5-be2b-4f6d-9863-92b0d2a840d5 tempest-VolumesTransfersTest-113664932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e6f0daf5-be2b-4f6d-9863-92b0d2a840d5 tempest-VolumesTransfersTest-113664932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:16 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e6f0daf5-be2b-4f6d-9863-92b0d2a840d5 tempest-VolumesTransfersTest-113664932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:16 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e6f0daf5-be2b-4f6d-9863-92b0d2a840d5 tempest-VolumesTransfersTest-113664932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e6f0daf5-be2b-4f6d-9863-92b0d2a840d5 tempest-VolumesTransfersTest-113664932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e6f0daf5-be2b-4f6d-9863-92b0d2a840d5 tempest-VolumesTransfersTest-113664932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:16 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:34:16 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-82256956-d380-46b3-b4db-e488dc364e50 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-82256956-d380-46b3-b4db-e488dc364e50 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-82256956-d380-46b3-b4db-e488dc364e50 tempest-VolumesSnapshotTestJSON-1115347481 None] Creating offline snapshot 371821c2-558b-4673-b1a1-925a076c3eb7 of volume 2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:34:17 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a3a882-6d83-457b-a201-6ed5b75be651]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-82256956-d380-46b3-b4db-e488dc364e50 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:17 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e6f0daf5-be2b-4f6d-9863-92b0d2a840d5 tempest-VolumesTransfersTest-113664932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.887s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:17 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-e6f0daf5-be2b-4f6d-9863-92b0d2a840d5 tempest-VolumesTransfersTest-113664932 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:34:17 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-e6f0daf5-be2b-4f6d-9863-92b0d2a840d5 tempest-VolumesTransfersTest-113664932 None] Deleted volume successfully. Jul 10 00:34:17 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e6f0daf5-be2b-4f6d-9863-92b0d2a840d5 tempest-VolumesTransfersTest-113664932 None] Lock "cinder-4cb8801b-5f52-44bb-9763-83a808826427-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:17 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-43baf1fa-a59c-4ae1-8422-cafc3dc6b97e tempest-VolumesExtendTest-2140193734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac" returned: 0 in 1.189s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-43baf1fa-a59c-4ae1-8422-cafc3dc6b97e tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.94dc690c-6a33-4d21-bb3b-71bcfa757139 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:17 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 Jul 10 00:34:17 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:17 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.94dc690c-6a33-4d21-bb3b-71bcfa757139 Jul 10 00:34:17 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:18 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-82256956-d380-46b3-b4db-e488dc364e50 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6" returned: 0 in 1.115s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-82256956-d380-46b3-b4db-e488dc364e50 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.371821c2-558b-4673-b1a1-925a076c3eb7 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:18 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.371821c2-558b-4673-b1a1-925a076c3eb7 1G Jul 10 00:34:18 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:18 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-43baf1fa-a59c-4ae1-8422-cafc3dc6b97e tempest-VolumesExtendTest-2140193734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.94dc690c-6a33-4d21-bb3b-71bcfa757139" returned: 0 in 1.196s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-43baf1fa-a59c-4ae1-8422-cafc3dc6b97e tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.94dc690c-6a33-4d21-bb3b-71bcfa757139 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:18 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.94dc690c-6a33-4d21-bb3b-71bcfa757139 Jul 10 00:34:18 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:19 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-43baf1fa-a59c-4ae1-8422-cafc3dc6b97e tempest-VolumesExtendTest-2140193734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac.94dc690c-6a33-4d21-bb3b-71bcfa757139" returned: 0 in 0.778s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:19 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-43baf1fa-a59c-4ae1-8422-cafc3dc6b97e tempest-VolumesExtendTest-2140193734 None] Lock "cinder-quobyte-94dc690c-6a33-4d21-bb3b-71bcfa757139" released by "_delete_snapshot" :: held 4.453s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:19 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-43baf1fa-a59c-4ae1-8422-cafc3dc6b97e tempest-VolumesExtendTest-2140193734 None] Lock "cinder-quobyte-82b29a1c-13ee-4a46-a759-c2605fcb3bac" released by "delete_snapshot" :: held 4.488s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:19 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-82256956-d380-46b3-b4db-e488dc364e50 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.371821c2-558b-4673-b1a1-925a076c3eb7 1G" returned: 0 in 1.179s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-82256956-d380-46b3-b4db-e488dc364e50 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.371821c2-558b-4673-b1a1-925a076c3eb7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:19 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.371821c2-558b-4673-b1a1-925a076c3eb7 Jul 10 00:34:19 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:19 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-43baf1fa-a59c-4ae1-8422-cafc3dc6b97e tempest-VolumesExtendTest-2140193734 None] Created reservations ['1da161ba-8167-4505-a48d-2af75637a177', '7f0b5662-0104-4241-8a75-d0a852b24688', '78d074ea-e76d-429c-920b-03d0262e2084', '900c9498-1bb5-4c15-b2ad-521aa32260a3'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:34:19 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-43baf1fa-a59c-4ae1-8422-cafc3dc6b97e tempest-VolumesExtendTest-2140193734 None] Delete snapshot completed successfully. Jul 10 00:34:19 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-43baf1fa-a59c-4ae1-8422-cafc3dc6b97e tempest-VolumesExtendTest-2140193734 None] Lock "cinder-94dc690c-6a33-4d21-bb3b-71bcfa757139-delete_snapshot" released by "delete_snapshot" :: held 4.698s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-6f710bc3-db82-4ba6-9b7e-a95ecd020560 tempest-VolumesExtendTest-2140193734 None] Acquiring lock "cinder-82b29a1c-13ee-4a46-a759-c2605fcb3bac-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-6f710bc3-db82-4ba6-9b7e-a95ecd020560 tempest-VolumesExtendTest-2140193734 None] Lock "cinder-82b29a1c-13ee-4a46-a759-c2605fcb3bac-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-6f710bc3-db82-4ba6-9b7e-a95ecd020560 tempest-VolumesExtendTest-2140193734 None] Acquiring lock "cinder-quobyte-82b29a1c-13ee-4a46-a759-c2605fcb3bac" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-6f710bc3-db82-4ba6-9b7e-a95ecd020560 tempest-VolumesExtendTest-2140193734 None] Lock "cinder-quobyte-82b29a1c-13ee-4a46-a759-c2605fcb3bac" acquired by "delete_volume" :: waited 0.027s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:20 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-82256956-d380-46b3-b4db-e488dc364e50 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.371821c2-558b-4673-b1a1-925a076c3eb7" returned: 0 in 1.009s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:20 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-82256956-d380-46b3-b4db-e488dc364e50 tempest-VolumesSnapshotTestJSON-1115347481 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.371821c2-558b-4673-b1a1-925a076c3eb7 is being set with open permissions: ugo+rw Jul 10 00:34:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-82256956-d380-46b3-b4db-e488dc364e50 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.371821c2-558b-4673-b1a1-925a076c3eb7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:20 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9df4932-3115-4333-a60e-48e94593916a]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6f710bc3-db82-4ba6-9b7e-a95ecd020560 tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:20 devstack sudo[99469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.371821c2-558b-4673-b1a1-925a076c3eb7 Jul 10 00:34:20 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:20 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac Jul 10 00:34:21 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:21 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-82256956-d380-46b3-b4db-e488dc364e50 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.371821c2-558b-4673-b1a1-925a076c3eb7" returned: 0 in 0.804s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-82256956-d380-46b3-b4db-e488dc364e50 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:21 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.info Jul 10 00:34:21 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:21 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6f710bc3-db82-4ba6-9b7e-a95ecd020560 tempest-VolumesExtendTest-2140193734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac" returned: 0 in 1.103s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6f710bc3-db82-4ba6-9b7e-a95ecd020560 tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:21 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac Jul 10 00:34:21 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:22 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-82256956-d380-46b3-b4db-e488dc364e50 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.info" returned: 0 in 0.849s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:22 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-82256956-d380-46b3-b4db-e488dc364e50 tempest-VolumesSnapshotTestJSON-1115347481 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.info is being set with open permissions: ugo+rw Jul 10 00:34:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-82256956-d380-46b3-b4db-e488dc364e50 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:22 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.info Jul 10 00:34:22 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:22 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6f710bc3-db82-4ba6-9b7e-a95ecd020560 tempest-VolumesExtendTest-2140193734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-82b29a1c-13ee-4a46-a759-c2605fcb3bac" returned: 0 in 0.812s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:22 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-6f710bc3-db82-4ba6-9b7e-a95ecd020560 tempest-VolumesExtendTest-2140193734 None] Lock "cinder-quobyte-82b29a1c-13ee-4a46-a759-c2605fcb3bac" released by "delete_volume" :: held 2.012s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:22 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-6f710bc3-db82-4ba6-9b7e-a95ecd020560 tempest-VolumesExtendTest-2140193734 None] Created reservations ['64b22ba8-bcb6-4639-b041-b42ed02816fb', '996a401f-18cc-4943-bfe5-fe0c7d3b9cf5', 'ddaaa2b9-075b-4f60-a14f-ec1fd27841d6', '5c300fa3-5f90-413b-99e3-0f3c638b2a9d'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:34:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6f710bc3-db82-4ba6-9b7e-a95ecd020560 tempest-VolumesExtendTest-2140193734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6f710bc3-db82-4ba6-9b7e-a95ecd020560 tempest-VolumesExtendTest-2140193734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:22 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-6f710bc3-db82-4ba6-9b7e-a95ecd020560 tempest-VolumesExtendTest-2140193734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:22 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-6f710bc3-db82-4ba6-9b7e-a95ecd020560 tempest-VolumesExtendTest-2140193734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6f710bc3-db82-4ba6-9b7e-a95ecd020560 tempest-VolumesExtendTest-2140193734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6f710bc3-db82-4ba6-9b7e-a95ecd020560 tempest-VolumesExtendTest-2140193734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:23 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:34:23 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:23 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-82256956-d380-46b3-b4db-e488dc364e50 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.info" returned: 0 in 0.902s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-82256956-d380-46b3-b4db-e488dc364e50 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.027s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:23 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-82256956-d380-46b3-b4db-e488dc364e50 tempest-VolumesSnapshotTestJSON-1115347481 None] Create snapshot completed successfully Jul 10 00:34:23 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6f710bc3-db82-4ba6-9b7e-a95ecd020560 tempest-VolumesExtendTest-2140193734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.826s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:23 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-6f710bc3-db82-4ba6-9b7e-a95ecd020560 tempest-VolumesExtendTest-2140193734 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:34:23 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-6f710bc3-db82-4ba6-9b7e-a95ecd020560 tempest-VolumesExtendTest-2140193734 None] Deleted volume successfully. Jul 10 00:34:23 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-6f710bc3-db82-4ba6-9b7e-a95ecd020560 tempest-VolumesExtendTest-2140193734 None] Lock "cinder-82b29a1c-13ee-4a46-a759-c2605fcb3bac-delete_volume" released by "delete_volume" :: held 3.146s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Flow 'volume_create_manager' (7b5730f1-b6f0-477b-afb3-5927d624a6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e21f987-edf9-4847-b5c2-744330c271a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e21f987-edf9-4847-b5c2-744330c271a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-312246565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbedeb8b-49b1-4ff4-933a-7f64ce845c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a27e82cdaeb400cbc1dc5423ebb04a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=371821c2-558b-4673-b1a1-925a076c3eb7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:24Z,use_quota=True,user_id='91a89fc2310445f789b9cd98c4058f18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8afb82fe-c5ab-4c19-8990-059c327cfd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8afb82fe-c5ab-4c19-8990-059c327cfd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d70e335e-4f92-414c-8093-8acd4b052918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d70e335e-4f92-414c-8093-8acd4b052918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cbedeb8b-49b1-4ff4-933a-7f64ce845c81', 'volume_name': 'volume-cbedeb8b-49b1-4ff4-933a-7f64ce845c81', 'volume_size': 1, 'snapshot_id': '371821c2-558b-4673-b1a1-925a076c3eb7'}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5325f883-ff19-4ced-a0a5-9c5fbb005970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5325f883-ff19-4ced-a0a5-9c5fbb005970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b0b975-1836-4ec5-a6af-3814294338a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:24 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Volume cbedeb8b-49b1-4ff4-933a-7f64ce845c81: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cbedeb8b-49b1-4ff4-933a-7f64ce845c81', 'volume_size': 1, 'snapshot_id': '371821c2-558b-4673-b1a1-925a076c3eb7'} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "cinder-quobyte-371821c2-558b-4673-b1a1-925a076c3eb7-cbedeb8b-49b1-4ff4-933a-7f64ce845c81" by "_create_volume_from_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-371821c2-558b-4673-b1a1-925a076c3eb7-cbedeb8b-49b1-4ff4-933a-7f64ce845c81" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Creating volume cbedeb8b-49b1-4ff4-933a-7f64ce845c81 from snapshot 371821c2-558b-4673-b1a1-925a076c3eb7 {{(pid=88119) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "cinder-quobyte-cbedeb8b-49b1-4ff4-933a-7f64ce845c81" by "_copy_volume_from_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-cbedeb8b-49b1-4ff4-933a-7f64ce845c81" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] snapshot: 371821c2-558b-4673-b1a1-925a076c3eb7, volume: cbedeb8b-49b1-4ff4-933a-7f64ce845c81, {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[be56cfbe-18ac-4a65-b376-d5a079768de4]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.371821c2-558b-4673-b1a1-925a076c3eb7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:24 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.371821c2-558b-4673-b1a1-925a076c3eb7 Jul 10 00:34:24 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:25 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.371821c2-558b-4673-b1a1-925a076c3eb7" returned: 0 in 1.019s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:25 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:34:25 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 00:34:25 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Creating direct copy from snapshot {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 00:34:25 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8426c58-c71c-4684-a4c9-f5c72a339ceb]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:25 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 Jul 10 00:34:25 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:26 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6" returned: 0 in 0.842s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:26 devstack cinder-volume[88119]: DEBUG cinder.utils [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Path /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cbedeb8b-49b1-4ff4-933a-7f64ce845c81 not found in is_blk_device check {{(pid=88119) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 00:34:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cbedeb8b-49b1-4ff4-933a-7f64ce845c81 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:26 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cbedeb8b-49b1-4ff4-933a-7f64ce845c81 Jul 10 00:34:26 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:30 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:34:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Flow 'volume_create_manager' (dc344048-4b28-4db0-9fa4-a0f4d75dcc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b3d514-c959-4272-bb3f-2f7bc1f58b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b3d514-c959-4272-bb3f-2f7bc1f58b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1031018298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89467ec7-b94c-4633-bd0e-07c6d3a19ee1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='297a9fe6c258483681826fe655e68594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:30Z,use_quota=True,user_id='7315c0abce26475995b72eda8a337831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36faaeb4-7a05-4f85-a356-4d08acbf4b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36faaeb4-7a05-4f85-a356-4d08acbf4b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ac5463a-779b-4d89-8fd5-acb0e9e847d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ac5463a-779b-4d89-8fd5-acb0e9e847d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89467ec7-b94c-4633-bd0e-07c6d3a19ee1', 'volume_name': 'volume-89467ec7-b94c-4633-bd0e-07c6d3a19ee1', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c011df-b130-4e70-8623-84dc1c40bf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c011df-b130-4e70-8623-84dc1c40bf3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c805e47b-079f-4186-8b0e-f625c69fe88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:30 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Volume 89467ec7-b94c-4633-bd0e-07c6d3a19ee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89467ec7-b94c-4633-bd0e-07c6d3a19ee1', 'volume_size': 1} Jul 10 00:34:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:34:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:31 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:34:31 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:33 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.386s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:33 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:34:33 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:34:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 29 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:34:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:34:33 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cbedeb8b-49b1-4ff4-933a-7f64ce845c81" returned: 0 in 6.581s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:33 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc16c474-88b2-4d3e-853a-414e806e128c]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:33 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 Jul 10 00:34:33 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:34 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6" returned: 0 in 1.222s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:34 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Image conversion details: src /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6, size 1024.00 MB, duration 6.58 sec, destination /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cbedeb8b-49b1-4ff4-933a-7f64ce845c81 {{(pid=88119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:34:34 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Converted 1024.00 MB image at 155.59 MB/s Jul 10 00:34:34 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cbedeb8b-49b1-4ff4-933a-7f64ce845c81 is being set with open permissions: ugo+rw Jul 10 00:34:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cbedeb8b-49b1-4ff4-933a-7f64ce845c81 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:34 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cbedeb8b-49b1-4ff4-933a-7f64ce845c81 Jul 10 00:34:34 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:35 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cbedeb8b-49b1-4ff4-933a-7f64ce845c81" returned: 0 in 0.694s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-cbedeb8b-49b1-4ff4-933a-7f64ce845c81" released by "_copy_volume_from_snapshot" :: held 10.481s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-371821c2-558b-4673-b1a1-925a076c3eb7-cbedeb8b-49b1-4ff4-933a-7f64ce845c81" released by "_create_volume_from_snapshot" :: held 10.522s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.539s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.387s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1031018298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89467ec7-b94c-4633-bd0e-07c6d3a19ee1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='297a9fe6c258483681826fe655e68594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:30Z,use_quota=True,user_id='7315c0abce26475995b72eda8a337831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:34:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Creating volume 89467ec7-b94c-4633-bd0e-07c6d3a19ee1 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:34:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:34:35 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:34:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-89467ec7-b94c-4633-bd0e-07c6d3a19ee1 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:35 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-89467ec7-b94c-4633-bd0e-07c6d3a19ee1 1073741824 Jul 10 00:34:35 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b0b975-1836-4ec5-a6af-3814294338a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbedeb8b-49b1-4ff4-933a-7f64ce845c81', 'volume_size': 1, 'snapshot_id': '371821c2-558b-4673-b1a1-925a076c3eb7'}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6782479c-c64a-49d2-ad9f-bd34b988cc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:35 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Volume volume-cbedeb8b-49b1-4ff4-933a-7f64ce845c81 (cbedeb8b-49b1-4ff4-933a-7f64ce845c81): created successfully Jul 10 00:34:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6782479c-c64a-49d2-ad9f-bd34b988cc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Flow 'volume_create_manager' (7b5730f1-b6f0-477b-afb3-5927d624a6fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:35 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-d7462a54-9ebc-44f4-b991-1857bf1f5064 tempest-VolumesSnapshotTestJSON-1115347481 None] Created volume successfully. Jul 10 00:34:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3cc90824-f2ba-480e-b45e-c2d417bcea59 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "cinder-cbedeb8b-49b1-4ff4-933a-7f64ce845c81-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3cc90824-f2ba-480e-b45e-c2d417bcea59 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-cbedeb8b-49b1-4ff4-933a-7f64ce845c81-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3cc90824-f2ba-480e-b45e-c2d417bcea59 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "cinder-quobyte-cbedeb8b-49b1-4ff4-933a-7f64ce845c81" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:36 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3cc90824-f2ba-480e-b45e-c2d417bcea59 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-cbedeb8b-49b1-4ff4-933a-7f64ce845c81" acquired by "delete_volume" :: waited 0.043s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:36 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7213f9-7547-4a35-a709-3dbe4c9728e2]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cc90824-f2ba-480e-b45e-c2d417bcea59 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cbedeb8b-49b1-4ff4-933a-7f64ce845c81 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:36 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cbedeb8b-49b1-4ff4-933a-7f64ce845c81 Jul 10 00:34:36 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:36 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-89467ec7-b94c-4633-bd0e-07c6d3a19ee1 1073741824" returned: 0 in 1.192s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-89467ec7-b94c-4633-bd0e-07c6d3a19ee1 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:36 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-89467ec7-b94c-4633-bd0e-07c6d3a19ee1 Jul 10 00:34:36 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:37 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cc90824-f2ba-480e-b45e-c2d417bcea59 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cbedeb8b-49b1-4ff4-933a-7f64ce845c81" returned: 0 in 0.977s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cc90824-f2ba-480e-b45e-c2d417bcea59 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cbedeb8b-49b1-4ff4-933a-7f64ce845c81 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:37 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-89467ec7-b94c-4633-bd0e-07c6d3a19ee1" returned: 0 in 0.775s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] <== create_volume: return (2024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:34:37 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cbedeb8b-49b1-4ff4-933a-7f64ce845c81 Jul 10 00:34:37 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.033s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c805e47b-079f-4186-8b0e-f625c69fe88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89467ec7-b94c-4633-bd0e-07c6d3a19ee1', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (251d0908-61f9-414b-9613-01c394535276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:37 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Volume volume-89467ec7-b94c-4633-bd0e-07c6d3a19ee1 (89467ec7-b94c-4633-bd0e-07c6d3a19ee1): created successfully Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (251d0908-61f9-414b-9613-01c394535276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Flow 'volume_create_manager' (dc344048-4b28-4db0-9fa4-a0f4d75dcc30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:37 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-c4571251-8828-4533-8f12-9bd8391d4c79 tempest-VolumesGetTest-47319286 None] Created volume successfully. Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Flow 'volume_create_manager' (f2ce1d00-a21c-4c43-a37e-a71bfcef287d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2bd5b28-bfb0-44af-9cc3-460446f49e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2bd5b28-bfb0-44af-9cc3-460446f49e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-292947124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f811c93-ab5c-4d73-8fba-bdd03a057daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae3b3e7ce8547e7a487225d36d457f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:37Z,use_quota=True,user_id='992d3d88eafe45f48bd22fa85ebb899c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5dbc6417-5dd9-4e98-84b9-89da6c704041),volume_type_id=5dbc6417-5dd9-4e98-84b9-89da6c704041)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b047e774-9eb8-4833-834e-ecb564d956a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b047e774-9eb8-4833-834e-ecb564d956a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66240ae1-f012-421e-b6ce-5c39682dfb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66240ae1-f012-421e-b6ce-5c39682dfb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f811c93-ab5c-4d73-8fba-bdd03a057daf', 'volume_name': 'volume-8f811c93-ab5c-4d73-8fba-bdd03a057daf', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3f727c-8052-4c2a-a394-bb411aed350f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3f727c-8052-4c2a-a394-bb411aed350f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90f41c4-8992-4cf0-ace4-4def6996203a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:37 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Volume 8f811c93-ab5c-4d73-8fba-bdd03a057daf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f811c93-ab5c-4d73-8fba-bdd03a057daf', 'volume_size': 1} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-292947124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f811c93-ab5c-4d73-8fba-bdd03a057daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae3b3e7ce8547e7a487225d36d457f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:37Z,use_quota=True,user_id='992d3d88eafe45f48bd22fa85ebb899c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5dbc6417-5dd9-4e98-84b9-89da6c704041),volume_type_id=5dbc6417-5dd9-4e98-84b9-89da6c704041)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Creating volume 8f811c93-ab5c-4d73-8fba-bdd03a057daf {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:34:37 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f811c93-ab5c-4d73-8fba-bdd03a057daf 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:37 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f811c93-ab5c-4d73-8fba-bdd03a057daf 1073741824 Jul 10 00:34:37 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Flow 'volume_create_manager' (11f28edf-db4a-4172-b22d-71377d8b8927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d433a052-de08-4528-ac8f-906cbbf6a255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d433a052-de08-4528-ac8f-906cbbf6a255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-878193860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=048053d2-90d8-477c-9621-f7f892b68f14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae3b3e7ce8547e7a487225d36d457f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:38Z,use_quota=True,user_id='992d3d88eafe45f48bd22fa85ebb899c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a60e172-182d-45df-b01e-0e1e3b747645),volume_type_id=3a60e172-182d-45df-b01e-0e1e3b747645)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (465e36a9-8c30-488a-8d51-c608f5a9ea45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (465e36a9-8c30-488a-8d51-c608f5a9ea45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9420a1-31ea-4271-b90a-9c23045a6efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9420a1-31ea-4271-b90a-9c23045a6efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '048053d2-90d8-477c-9621-f7f892b68f14', 'volume_name': 'volume-048053d2-90d8-477c-9621-f7f892b68f14', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e69ac2d-9ffd-4f6b-b7e4-caf0576e6aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e69ac2d-9ffd-4f6b-b7e4-caf0576e6aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb6644e-0073-4dc0-86f2-71d7e59c7a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:37 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Volume 048053d2-90d8-477c-9621-f7f892b68f14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-048053d2-90d8-477c-9621-f7f892b68f14', 'volume_size': 1} Jul 10 00:34:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:38 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cc90824-f2ba-480e-b45e-c2d417bcea59 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cbedeb8b-49b1-4ff4-933a-7f64ce845c81" returned: 0 in 1.065s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:38 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3cc90824-f2ba-480e-b45e-c2d417bcea59 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-cbedeb8b-49b1-4ff4-933a-7f64ce845c81" released by "delete_volume" :: held 2.103s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:38 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-3cc90824-f2ba-480e-b45e-c2d417bcea59 tempest-VolumesSnapshotTestJSON-1115347481 None] Created reservations ['795bffc8-8ab6-485b-9638-1b867d66c782', '9a6e112a-418f-4b04-a8f8-11bfe382e8aa', '9f1b8c27-2274-44ec-b11f-9ca45c17f780', 'cd6d8686-cb40-46a3-b94a-24d980bad656'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:34:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3cc90824-f2ba-480e-b45e-c2d417bcea59 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3cc90824-f2ba-480e-b45e-c2d417bcea59 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:38 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-3cc90824-f2ba-480e-b45e-c2d417bcea59 tempest-VolumesSnapshotTestJSON-1115347481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:38 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-3cc90824-f2ba-480e-b45e-c2d417bcea59 tempest-VolumesSnapshotTestJSON-1115347481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3cc90824-f2ba-480e-b45e-c2d417bcea59 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cc90824-f2ba-480e-b45e-c2d417bcea59 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:38 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:34:38 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:38 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f811c93-ab5c-4d73-8fba-bdd03a057daf 1073741824" returned: 0 in 1.413s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:38 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:34:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Flow 'volume_create_manager' (b821de2d-26cb-42e0-97e2-497d725d5a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368a7044-b909-415a-a068-f705e4297921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f811c93-ab5c-4d73-8fba-bdd03a057daf {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368a7044-b909-415a-a068-f705e4297921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-939603535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d3fcfaa-0678-418a-a352-48050ddc33c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae3b3e7ce8547e7a487225d36d457f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:39Z,use_quota=True,user_id='992d3d88eafe45f48bd22fa85ebb899c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97c9357d-aae2-4a95-a004-ed11fb168364),volume_type_id=97c9357d-aae2-4a95-a004-ed11fb168364)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91358bdd-1431-4743-87a5-037e493730d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91358bdd-1431-4743-87a5-037e493730d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a927c9-2791-4c48-8ee6-ab551d501a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:38 devstack cinder-volume[88119]: DEBUG cinder.image.glance [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Creating Keystone auth plugin from conf {{(pid=88119) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 00:34:38 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f811c93-ab5c-4d73-8fba-bdd03a057daf Jul 10 00:34:38 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:39 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cc90824-f2ba-480e-b45e-c2d417bcea59 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.949s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-3cc90824-f2ba-480e-b45e-c2d417bcea59 tempest-VolumesSnapshotTestJSON-1115347481 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:34:39 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-3cc90824-f2ba-480e-b45e-c2d417bcea59 tempest-VolumesSnapshotTestJSON-1115347481 None] Deleted volume successfully. Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3cc90824-f2ba-480e-b45e-c2d417bcea59 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-cbedeb8b-49b1-4ff4-933a-7f64ce845c81-delete_volume" released by "delete_volume" :: held 3.477s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a927c9-2791-4c48-8ee6-ab551d501a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2d3fcfaa-0678-418a-a352-48050ddc33c0', 'volume_name': 'volume-2d3fcfaa-0678-418a-a352-48050ddc33c0', 'volume_size': 1, 'image_id': '626a6173-a0b3-4812-858f-071225ab8b89', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/626a6173-a0b3-4812-858f-071225ab8b89', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--343962359', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bae3b3e7ce8547e7a487225d36d457f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '626a6173-a0b3-4812-858f-071225ab8b89', 'created_at': datetime.datetime(2026, 7, 9, 22, 34, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 34, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/626a6173-a0b3-4812-858f-071225ab8b89/file', 'properties': {}}, 'image_service': }' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19a8fc4-de05-4483-bf26-daea2a869677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19a8fc4-de05-4483-bf26-daea2a869677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d5ee0de-2af5-40d6-8c3c-ad0beeea5dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:39 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Volume 2d3fcfaa-0678-418a-a352-48050ddc33c0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2d3fcfaa-0678-418a-a352-48050ddc33c0', 'volume_size': 1, 'image_id': '626a6173-a0b3-4812-858f-071225ab8b89', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/626a6173-a0b3-4812-858f-071225ab8b89', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--343962359', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bae3b3e7ce8547e7a487225d36d457f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '626a6173-a0b3-4812-858f-071225ab8b89', 'created_at': datetime.datetime(2026, 7, 9, 22, 34, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 34, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/626a6173-a0b3-4812-858f-071225ab8b89/file', 'properties': {}}, 'image_service': } Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Trying to clone 2d3fcfaa-0678-418a-a352-48050ddc33c0 from image 626a6173-a0b3-4812-858f-071225ab8b89 at location (None, [{'url': 'file:///opt/stack/data/glance/images/626a6173-a0b3-4812-858f-071225ab8b89', 'metadata': {}}]). {{(pid=88119) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-92fb88f8-0f86-4cee-ba58-968c883f6cf8 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "cinder-371821c2-558b-4673-b1a1-925a076c3eb7-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-92fb88f8-0f86-4cee-ba58-968c883f6cf8 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-371821c2-558b-4673-b1a1-925a076c3eb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-92fb88f8-0f86-4cee-ba58-968c883f6cf8 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "cinder-quobyte-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-92fb88f8-0f86-4cee-ba58-968c883f6cf8 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-92fb88f8-0f86-4cee-ba58-968c883f6cf8 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "cinder-quobyte-371821c2-558b-4673-b1a1-925a076c3eb7" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-92fb88f8-0f86-4cee-ba58-968c883f6cf8 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-371821c2-558b-4673-b1a1-925a076c3eb7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-92fb88f8-0f86-4cee-ba58-968c883f6cf8 tempest-VolumesSnapshotTestJSON-1115347481 None] Deleting offline snapshot 371821c2-558b-4673-b1a1-925a076c3eb7 of volume 2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-92fb88f8-0f86-4cee-ba58-968c883f6cf8 tempest-VolumesSnapshotTestJSON-1115347481 None] snapshot_file for this snap is: volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.371821c2-558b-4673-b1a1-925a076c3eb7 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd32643-8597-443c-b0b0-8971da98cd45]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92fb88f8-0f86-4cee-ba58-968c883f6cf8 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.371821c2-558b-4673-b1a1-925a076c3eb7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:39 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:34:39 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.371821c2-558b-4673-b1a1-925a076c3eb7 Jul 10 00:34:39 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Flow 'volume_create_manager' (a3aef213-22de-4bb3-ac61-8d74f08c8241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22103ac-2e83-49c2-a167-9a588c20ba50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f811c93-ab5c-4d73-8fba-bdd03a057daf" returned: 0 in 0.968s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] <== create_volume: return (2517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.520s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.994s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-878193860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=048053d2-90d8-477c-9621-f7f892b68f14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae3b3e7ce8547e7a487225d36d457f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:38Z,use_quota=True,user_id='992d3d88eafe45f48bd22fa85ebb899c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3a60e172-182d-45df-b01e-0e1e3b747645),volume_type_id=3a60e172-182d-45df-b01e-0e1e3b747645)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Creating volume 048053d2-90d8-477c-9621-f7f892b68f14 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:34:39 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-048053d2-90d8-477c-9621-f7f892b68f14 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22103ac-2e83-49c2-a167-9a588c20ba50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-337024338',display_name='tempest-VolumesGetTest-Volume-420254818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f76895-6145-49d0-a6e9-2d1b5c963724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='297a9fe6c258483681826fe655e68594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:40Z,use_quota=True,user_id='7315c0abce26475995b72eda8a337831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:39 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-048053d2-90d8-477c-9621-f7f892b68f14 1073741824 Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20debbf2-30cf-4dbc-88a0-e5a311a2d87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:39 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20debbf2-30cf-4dbc-88a0-e5a311a2d87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30b45dac-34c8-48cb-b52a-4d31adbb0aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30b45dac-34c8-48cb-b52a-4d31adbb0aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0f76895-6145-49d0-a6e9-2d1b5c963724', 'volume_name': 'volume-b0f76895-6145-49d0-a6e9-2d1b5c963724', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76514ac-0833-4b44-b744-94654a3aae3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76514ac-0833-4b44-b744-94654a3aae3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28605b9-5318-4891-8d69-061a238d70e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:40 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Volume b0f76895-6145-49d0-a6e9-2d1b5c963724: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0f76895-6145-49d0-a6e9-2d1b5c963724', 'volume_size': 1} Jul 10 00:34:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90f41c4-8992-4cf0-ace4-4def6996203a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f811c93-ab5c-4d73-8fba-bdd03a057daf', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5333108-7986-4c79-a314-91ec8f263702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:40 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Volume volume-8f811c93-ab5c-4d73-8fba-bdd03a057daf (8f811c93-ab5c-4d73-8fba-bdd03a057daf): created successfully Jul 10 00:34:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5333108-7986-4c79-a314-91ec8f263702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Flow 'volume_create_manager' (f2ce1d00-a21c-4c43-a37e-a71bfcef287d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:40 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-1c09eacf-bf8e-4f73-a929-905a09177219 tempest-TestInstancesWithCinderVolumes-493128608 None] Created volume successfully. Jul 10 00:34:40 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92fb88f8-0f86-4cee-ba58-968c883f6cf8 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.371821c2-558b-4673-b1a1-925a076c3eb7" returned: 0 in 1.190s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-92fb88f8-0f86-4cee-ba58-968c883f6cf8 tempest-VolumesSnapshotTestJSON-1115347481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:34:40 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf1b9e9-d9d1-4119-aec7-581e477d6660]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92fb88f8-0f86-4cee-ba58-968c883f6cf8 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:41 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-048053d2-90d8-477c-9621-f7f892b68f14 1073741824" returned: 0 in 1.098s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-048053d2-90d8-477c-9621-f7f892b68f14 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:41 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 Jul 10 00:34:41 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:41 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-048053d2-90d8-477c-9621-f7f892b68f14 Jul 10 00:34:41 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:41 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-048053d2-90d8-477c-9621-f7f892b68f14" returned: 0 in 0.853s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:41 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] <== create_volume: return (2006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:34:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.932s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:41 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-337024338',display_name='tempest-VolumesGetTest-Volume-420254818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f76895-6145-49d0-a6e9-2d1b5c963724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='297a9fe6c258483681826fe655e68594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:40Z,use_quota=True,user_id='7315c0abce26475995b72eda8a337831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:34:41 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Creating volume b0f76895-6145-49d0-a6e9-2d1b5c963724 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:34:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:41 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:41 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:41 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:34:41 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:34:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0f76895-6145-49d0-a6e9-2d1b5c963724 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:41 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0f76895-6145-49d0-a6e9-2d1b5c963724 1073741824 Jul 10 00:34:41 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:41 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb6644e-0073-4dc0-86f2-71d7e59c7a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-048053d2-90d8-477c-9621-f7f892b68f14', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:41 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:41 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be3abb2-576c-47ad-b9c3-b846f77edd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92fb88f8-0f86-4cee-ba58-968c883f6cf8 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6" returned: 0 in 1.079s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92fb88f8-0f86-4cee-ba58-968c883f6cf8 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.371821c2-558b-4673-b1a1-925a076c3eb7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:42 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Volume volume-048053d2-90d8-477c-9621-f7f892b68f14 (048053d2-90d8-477c-9621-f7f892b68f14): created successfully Jul 10 00:34:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be3abb2-576c-47ad-b9c3-b846f77edd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Flow 'volume_create_manager' (11f28edf-db4a-4172-b22d-71377d8b8927) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:42 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.371821c2-558b-4673-b1a1-925a076c3eb7 Jul 10 00:34:42 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:42 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-8e07857a-c93b-4bc9-9bf6-29ceb387d870 tempest-TestInstancesWithCinderVolumes-493128608 None] Created volume successfully. Jul 10 00:34:43 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92fb88f8-0f86-4cee-ba58-968c883f6cf8 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.371821c2-558b-4673-b1a1-925a076c3eb7" returned: 0 in 1.073s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92fb88f8-0f86-4cee-ba58-968c883f6cf8 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.371821c2-558b-4673-b1a1-925a076c3eb7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:43 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.371821c2-558b-4673-b1a1-925a076c3eb7 Jul 10 00:34:43 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:43 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0f76895-6145-49d0-a6e9-2d1b5c963724 1073741824" returned: 0 in 1.160s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0f76895-6145-49d0-a6e9-2d1b5c963724 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:43 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0f76895-6145-49d0-a6e9-2d1b5c963724 Jul 10 00:34:43 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:43 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_626a6173-a0b3-4812-858f-071225ab8b89_5ysugropdevstack@QuobyteHD, size 20.69 MB, duration 4.15 sec {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 00:34:43 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Image download 20.69 MB at 4.99 MB/s Jul 10 00:34:43 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cefcb7-139c-4806-991d-6530424f7d6a]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_626a6173-a0b3-4812-858f-071225ab8b89_5ysugropdevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:43 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_626a6173-a0b3-4812-858f-071225ab8b89_5ysugropdevstack@QuobyteHD Jul 10 00:34:43 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:43 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92fb88f8-0f86-4cee-ba58-968c883f6cf8 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6.371821c2-558b-4673-b1a1-925a076c3eb7" returned: 0 in 0.801s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-92fb88f8-0f86-4cee-ba58-968c883f6cf8 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-371821c2-558b-4673-b1a1-925a076c3eb7" released by "_delete_snapshot" :: held 4.333s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-92fb88f8-0f86-4cee-ba58-968c883f6cf8 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6" released by "delete_snapshot" :: held 4.368s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-92fb88f8-0f86-4cee-ba58-968c883f6cf8 tempest-VolumesSnapshotTestJSON-1115347481 None] Created reservations ['b5af6b71-31cf-4155-89fb-cba3f0db9085', '5f1fbfaa-dc7d-4be9-be7b-fdddacab8e44', '765cf228-408f-4a87-975d-c229a4076ed1', '85d45b67-3d47-4d0a-9068-a74b8800d625'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:34:44 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0f76895-6145-49d0-a6e9-2d1b5c963724" returned: 0 in 0.945s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] <== create_volume: return (2169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.176s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:44 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-92fb88f8-0f86-4cee-ba58-968c883f6cf8 tempest-VolumesSnapshotTestJSON-1115347481 None] Delete snapshot completed successfully. Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28605b9-5318-4891-8d69-061a238d70e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0f76895-6145-49d0-a6e9-2d1b5c963724', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4742f333-eab8-4b43-a27e-8b1fa94d98a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-92fb88f8-0f86-4cee-ba58-968c883f6cf8 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-371821c2-558b-4673-b1a1-925a076c3eb7-delete_snapshot" released by "delete_snapshot" :: held 4.591s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:44 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Volume volume-b0f76895-6145-49d0-a6e9-2d1b5c963724 (b0f76895-6145-49d0-a6e9-2d1b5c963724): created successfully Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4742f333-eab8-4b43-a27e-8b1fa94d98a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Flow 'volume_create_manager' (a3aef213-22de-4bb3-ac61-8d74f08c8241) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:44 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-1da4145d-1018-44f8-9cfe-1849ac777a64 tempest-VolumesGetTest-47319286 None] Created volume successfully. Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Flow 'volume_create_manager' (15019b5c-52e5-4ecd-a01c-db5e5ba812c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ac01c1-f709-4e9b-9a8a-d8ae95817481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ac01c1-f709-4e9b-9a8a-d8ae95817481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-109617548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=877b83e2-fe02-4161-b7ad-5b3ca510e214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a33b05bf18a442b1bc802781b72649f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:44Z,use_quota=True,user_id='c5cec9f5d78e4f4cb447a3b66920dabd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0a4ef73-7a4e-4a04-a3ca-bf97429193b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0a4ef73-7a4e-4a04-a3ca-bf97429193b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b5d0de-cdfe-4119-b44b-754b030ffe1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b5d0de-cdfe-4119-b44b-754b030ffe1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '877b83e2-fe02-4161-b7ad-5b3ca510e214', 'volume_name': 'volume-877b83e2-fe02-4161-b7ad-5b3ca510e214', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e354664-2ce3-4a76-91fa-2945fc32b513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e354664-2ce3-4a76-91fa-2945fc32b513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5003103a-d1fb-424e-ab93-c53d2638a228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:44 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Volume 877b83e2-fe02-4161-b7ad-5b3ca510e214: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-877b83e2-fe02-4161-b7ad-5b3ca510e214', 'volume_size': 1} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-109617548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=877b83e2-fe02-4161-b7ad-5b3ca510e214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a33b05bf18a442b1bc802781b72649f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:44Z,use_quota=True,user_id='c5cec9f5d78e4f4cb447a3b66920dabd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Creating volume 877b83e2-fe02-4161-b7ad-5b3ca510e214 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:34:44 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:44 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 1073741824 Jul 10 00:34:44 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:44 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_626a6173-a0b3-4812-858f-071225ab8b89_5ysugropdevstack@QuobyteHD" returned: 0 in 0.943s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Temporary image 626a6173-a0b3-4812-858f-071225ab8b89 is fetched for user 992d3d88eafe45f48bd22fa85ebb899c. {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[143318dd-5119-44a7-95ae-e86edd2d3e6f]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_626a6173-a0b3-4812-858f-071225ab8b89_5ysugropdevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:44 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_626a6173-a0b3-4812-858f-071225ab8b89_5ysugropdevstack@QuobyteHD Jul 10 00:34:44 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d6bf5477-00a2-4dbb-9f2f-895247fd479b tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "cinder-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d6bf5477-00a2-4dbb-9f2f-895247fd479b tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d6bf5477-00a2-4dbb-9f2f-895247fd479b tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "cinder-quobyte-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d6bf5477-00a2-4dbb-9f2f-895247fd479b tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6" acquired by "delete_volume" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:45 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[822a456b-3ac6-48e4-a29a-55b196a8d3d8]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d6bf5477-00a2-4dbb-9f2f-895247fd479b tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:45 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 Jul 10 00:34:45 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:45 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 1073741824" returned: 0 in 1.006s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-581e792a-bd03-4089-9421-46ea8555c246 tempest-VolumesGetTest-47319286 None] Acquiring lock "cinder-b0f76895-6145-49d0-a6e9-2d1b5c963724-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-581e792a-bd03-4089-9421-46ea8555c246 tempest-VolumesGetTest-47319286 None] Lock "cinder-b0f76895-6145-49d0-a6e9-2d1b5c963724-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:45 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 Jul 10 00:34:45 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-581e792a-bd03-4089-9421-46ea8555c246 tempest-VolumesGetTest-47319286 None] Acquiring lock "cinder-quobyte-b0f76895-6145-49d0-a6e9-2d1b5c963724" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-581e792a-bd03-4089-9421-46ea8555c246 tempest-VolumesGetTest-47319286 None] Lock "cinder-quobyte-b0f76895-6145-49d0-a6e9-2d1b5c963724" acquired by "delete_volume" :: waited 0.026s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:45 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_626a6173-a0b3-4812-858f-071225ab8b89_5ysugropdevstack@QuobyteHD" returned: 0 in 0.837s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:45 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3c93de-ea06-4115-9439-413451667c9e]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-581e792a-bd03-4089-9421-46ea8555c246 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0f76895-6145-49d0-a6e9-2d1b5c963724 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:45 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0f76895-6145-49d0-a6e9-2d1b5c963724 Jul 10 00:34:45 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:46 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d6bf5477-00a2-4dbb-9f2f-895247fd479b tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6" returned: 0 in 0.866s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d6bf5477-00a2-4dbb-9f2f-895247fd479b tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:46 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6 Jul 10 00:34:46 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:46 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214" returned: 0 in 0.829s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.713s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-939603535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d3fcfaa-0678-418a-a352-48050ddc33c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae3b3e7ce8547e7a487225d36d457f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:39Z,use_quota=True,user_id='992d3d88eafe45f48bd22fa85ebb899c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97c9357d-aae2-4a95-a004-ed11fb168364),volume_type_id=97c9357d-aae2-4a95-a004-ed11fb168364)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Creating volume 2d3fcfaa-0678-418a-a352-48050ddc33c0 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:34:46 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:46 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0 1073741824 Jul 10 00:34:46 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5003103a-d1fb-424e-ab93-c53d2638a228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-877b83e2-fe02-4161-b7ad-5b3ca510e214', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0d8bb4-f2d8-4cc8-aff5-8e2e0a95f49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:46 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Volume volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 (877b83e2-fe02-4161-b7ad-5b3ca510e214): created successfully Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0d8bb4-f2d8-4cc8-aff5-8e2e0a95f49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Flow 'volume_create_manager' (15019b5c-52e5-4ecd-a01c-db5e5ba812c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:46 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-50bd007f-ab98-452a-994a-fda322cee660 tempest-VolumesActionsTest-371201012 None] Created volume successfully. Jul 10 00:34:46 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-581e792a-bd03-4089-9421-46ea8555c246 tempest-VolumesGetTest-47319286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0f76895-6145-49d0-a6e9-2d1b5c963724" returned: 0 in 0.855s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-581e792a-bd03-4089-9421-46ea8555c246 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0f76895-6145-49d0-a6e9-2d1b5c963724 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:46 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0f76895-6145-49d0-a6e9-2d1b5c963724 Jul 10 00:34:46 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:46 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d6bf5477-00a2-4dbb-9f2f-895247fd479b tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6" returned: 0 in 0.692s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d6bf5477-00a2-4dbb-9f2f-895247fd479b tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6" released by "delete_volume" :: held 1.628s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-d6bf5477-00a2-4dbb-9f2f-895247fd479b tempest-VolumesSnapshotTestJSON-1115347481 None] Created reservations ['ee3d42b5-09b5-4bf9-ab48-96308c63c0fa', 'f93a6df4-3600-4436-8af0-fcdbe9ee5252', '7e0f3282-010c-4425-ad9e-dc36131c4d7a', '7ff28777-ab9d-4029-855f-f2e5ed6dd04b'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d6bf5477-00a2-4dbb-9f2f-895247fd479b tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d6bf5477-00a2-4dbb-9f2f-895247fd479b tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d6bf5477-00a2-4dbb-9f2f-895247fd479b tempest-VolumesSnapshotTestJSON-1115347481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d6bf5477-00a2-4dbb-9f2f-895247fd479b tempest-VolumesSnapshotTestJSON-1115347481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d6bf5477-00a2-4dbb-9f2f-895247fd479b tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d6bf5477-00a2-4dbb-9f2f-895247fd479b tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:46 devstack sudo[99669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:34:46 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:47 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-581e792a-bd03-4089-9421-46ea8555c246 tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0f76895-6145-49d0-a6e9-2d1b5c963724" returned: 0 in 0.666s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-581e792a-bd03-4089-9421-46ea8555c246 tempest-VolumesGetTest-47319286 None] Lock "cinder-quobyte-b0f76895-6145-49d0-a6e9-2d1b5c963724" released by "delete_volume" :: held 1.569s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:47 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-581e792a-bd03-4089-9421-46ea8555c246 tempest-VolumesGetTest-47319286 None] Created reservations ['4c715c43-eb57-4e5a-bf96-5cd1d1a85ad7', '2c8a6479-7f66-4693-ba12-5e863de82e66', '052007dd-ec2e-467a-9030-6c4eb5cf649d', '62485779-38e3-4ea9-a98f-4d8b339b1a75'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:34:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-581e792a-bd03-4089-9421-46ea8555c246 tempest-VolumesGetTest-47319286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-581e792a-bd03-4089-9421-46ea8555c246 tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-581e792a-bd03-4089-9421-46ea8555c246 tempest-VolumesGetTest-47319286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-581e792a-bd03-4089-9421-46ea8555c246 tempest-VolumesGetTest-47319286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-581e792a-bd03-4089-9421-46ea8555c246 tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-581e792a-bd03-4089-9421-46ea8555c246 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:47 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:47 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:34:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0 1073741824" returned: 0 in 0.980s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:47 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:47 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0 Jul 10 00:34:47 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-925d7f42-2b7e-4525-85f8-e9db3510b388 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "cinder-2142ba4f-b5a1-47aa-b103-d0a3c0f87379-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-925d7f42-2b7e-4525-85f8-e9db3510b388 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-2142ba4f-b5a1-47aa-b103-d0a3c0f87379-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-925d7f42-2b7e-4525-85f8-e9db3510b388 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "cinder-quobyte-2142ba4f-b5a1-47aa-b103-d0a3c0f87379" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-925d7f42-2b7e-4525-85f8-e9db3510b388 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-2142ba4f-b5a1-47aa-b103-d0a3c0f87379" acquired by "delete_volume" :: waited 0.028s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:47 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d6bf5477-00a2-4dbb-9f2f-895247fd479b tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.774s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:47 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-d6bf5477-00a2-4dbb-9f2f-895247fd479b tempest-VolumesSnapshotTestJSON-1115347481 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:34:47 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-d6bf5477-00a2-4dbb-9f2f-895247fd479b tempest-VolumesSnapshotTestJSON-1115347481 None] Deleted volume successfully. Jul 10 00:34:47 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[091f0d68-7d22-47d1-a5fd-844bd0ea9073]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-925d7f42-2b7e-4525-85f8-e9db3510b388 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d6bf5477-00a2-4dbb-9f2f-895247fd479b tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-2017aa4d-1ec5-413a-8be3-e3fc9bebb8d6-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:47 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379 Jul 10 00:34:47 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fefc3547-000d-40dc-a01d-964b778bccc7 tempest-VolumesGetTest-47319286 None] Acquiring lock "cinder-89467ec7-b94c-4633-bd0e-07c6d3a19ee1-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fefc3547-000d-40dc-a01d-964b778bccc7 tempest-VolumesGetTest-47319286 None] Lock "cinder-89467ec7-b94c-4633-bd0e-07c6d3a19ee1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fefc3547-000d-40dc-a01d-964b778bccc7 tempest-VolumesGetTest-47319286 None] Acquiring lock "cinder-quobyte-89467ec7-b94c-4633-bd0e-07c6d3a19ee1" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:34:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fefc3547-000d-40dc-a01d-964b778bccc7 tempest-VolumesGetTest-47319286 None] Lock "cinder-quobyte-89467ec7-b94c-4633-bd0e-07c6d3a19ee1" acquired by "delete_volume" :: waited 0.023s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:34:48 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfa39da-7400-47f7-8128-7c7fa2296002]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fefc3547-000d-40dc-a01d-964b778bccc7 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-89467ec7-b94c-4633-bd0e-07c6d3a19ee1 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:48 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-89467ec7-b94c-4633-bd0e-07c6d3a19ee1 Jul 10 00:34:48 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:48 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0" returned: 0 in 0.996s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] <== create_volume: return (2036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:34:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.041s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:48 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Attempting download of 626a6173-a0b3-4812-858f-071225ab8b89 ((None, [{'url': 'file:///opt/stack/data/glance/images/626a6173-a0b3-4812-858f-071225ab8b89', 'metadata': {}}])) to volume 2d3fcfaa-0678-418a-a352-48050ddc33c0. {{(pid=88119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 00:34:48 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e238f2-ae7b-4f6a-a42a-3e99c3c0c9b1]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_626a6173-a0b3-4812-858f-071225ab8b89_0ra89vo5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:48 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_626a6173-a0b3-4812-858f-071225ab8b89_0ra89vo5 Jul 10 00:34:48 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:48 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-581e792a-bd03-4089-9421-46ea8555c246 tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.350s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:48 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-581e792a-bd03-4089-9421-46ea8555c246 tempest-VolumesGetTest-47319286 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:34:48 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-581e792a-bd03-4089-9421-46ea8555c246 tempest-VolumesGetTest-47319286 None] Deleted volume successfully. Jul 10 00:34:48 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-581e792a-bd03-4089-9421-46ea8555c246 tempest-VolumesGetTest-47319286 None] Lock "cinder-b0f76895-6145-49d0-a6e9-2d1b5c963724-delete_volume" released by "delete_volume" :: held 3.230s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:48 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-925d7f42-2b7e-4525-85f8-e9db3510b388 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379" returned: 0 in 1.131s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-925d7f42-2b7e-4525-85f8-e9db3510b388 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:48 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379 Jul 10 00:34:48 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:49 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fefc3547-000d-40dc-a01d-964b778bccc7 tempest-VolumesGetTest-47319286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-89467ec7-b94c-4633-bd0e-07c6d3a19ee1" returned: 0 in 1.073s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fefc3547-000d-40dc-a01d-964b778bccc7 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-89467ec7-b94c-4633-bd0e-07c6d3a19ee1 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:49 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-89467ec7-b94c-4633-bd0e-07c6d3a19ee1 Jul 10 00:34:49 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:49 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_626a6173-a0b3-4812-858f-071225ab8b89_0ra89vo5" returned: 0 in 0.992s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_626a6173-a0b3-4812-858f-071225ab8b89_0ra89vo5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:49 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_626a6173-a0b3-4812-858f-071225ab8b89_0ra89vo5 Jul 10 00:34:49 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:49 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-925d7f42-2b7e-4525-85f8-e9db3510b388 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2142ba4f-b5a1-47aa-b103-d0a3c0f87379" returned: 0 in 0.818s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-925d7f42-2b7e-4525-85f8-e9db3510b388 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-quobyte-2142ba4f-b5a1-47aa-b103-d0a3c0f87379" released by "delete_volume" :: held 2.074s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:49 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-925d7f42-2b7e-4525-85f8-e9db3510b388 tempest-VolumesSnapshotTestJSON-1115347481 None] Created reservations ['b1451096-ad5e-41b8-ba5d-55ea00561935', '1c00aa93-bc3c-484e-b5ae-8027c772878e', '294b0347-fa27-439a-8beb-a34495e3cb15', '63969a63-0a1e-4022-8b43-3ace15b15200'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:34:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-925d7f42-2b7e-4525-85f8-e9db3510b388 tempest-VolumesSnapshotTestJSON-1115347481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-925d7f42-2b7e-4525-85f8-e9db3510b388 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-925d7f42-2b7e-4525-85f8-e9db3510b388 tempest-VolumesSnapshotTestJSON-1115347481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-925d7f42-2b7e-4525-85f8-e9db3510b388 tempest-VolumesSnapshotTestJSON-1115347481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-925d7f42-2b7e-4525-85f8-e9db3510b388 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-925d7f42-2b7e-4525-85f8-e9db3510b388 tempest-VolumesSnapshotTestJSON-1115347481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:49 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:34:49 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:49 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fefc3547-000d-40dc-a01d-964b778bccc7 tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-89467ec7-b94c-4633-bd0e-07c6d3a19ee1" returned: 0 in 0.790s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fefc3547-000d-40dc-a01d-964b778bccc7 tempest-VolumesGetTest-47319286 None] Lock "cinder-quobyte-89467ec7-b94c-4633-bd0e-07c6d3a19ee1" released by "delete_volume" :: held 1.920s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:49 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-fefc3547-000d-40dc-a01d-964b778bccc7 tempest-VolumesGetTest-47319286 None] Created reservations ['f8905222-f1a9-4ed5-a4a6-954e31ff946d', '6ea419db-85bd-4b40-9eeb-21e4d7155369', 'cd4b9fa9-7a79-4fb8-8d16-310f3e46feca', '6f20d885-c58e-4dcd-9cb0-04fe4521b8e4'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:34:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-fefc3547-000d-40dc-a01d-964b778bccc7 tempest-VolumesGetTest-47319286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-fefc3547-000d-40dc-a01d-964b778bccc7 tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-fefc3547-000d-40dc-a01d-964b778bccc7 tempest-VolumesGetTest-47319286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-fefc3547-000d-40dc-a01d-964b778bccc7 tempest-VolumesGetTest-47319286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-fefc3547-000d-40dc-a01d-964b778bccc7 tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fefc3547-000d-40dc-a01d-964b778bccc7 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:50 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:34:50 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:50 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_626a6173-a0b3-4812-858f-071225ab8b89_0ra89vo5" returned: 1 in 0.967s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_626a6173-a0b3-4812-858f-071225ab8b89_0ra89vo5' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:34:50 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6fd0bc-9c1e-4380-aa9f-67a948b2165b]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_626a6173-a0b3-4812-858f-071225ab8b89_5ysugropdevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:50 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_626a6173-a0b3-4812-858f-071225ab8b89_5ysugropdevstack@QuobyteHD Jul 10 00:34:50 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:34:51 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Flow 'volume_create_manager' (a61ab3b7-2d87-435a-a7aa-f0f5053df49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5cde1c1-801a-4229-98ad-3514138341ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-925d7f42-2b7e-4525-85f8-e9db3510b388 tempest-VolumesSnapshotTestJSON-1115347481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.268s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-925d7f42-2b7e-4525-85f8-e9db3510b388 tempest-VolumesSnapshotTestJSON-1115347481 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:34:51 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-925d7f42-2b7e-4525-85f8-e9db3510b388 tempest-VolumesSnapshotTestJSON-1115347481 None] Deleted volume successfully. Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5cde1c1-801a-4229-98ad-3514138341ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1864160755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4752971a-6439-4d64-b995-25e46f5c1d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='297a9fe6c258483681826fe655e68594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:51Z,use_quota=True,user_id='7315c0abce26475995b72eda8a337831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70e1c67-3c14-421d-81fa-16d411b41be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70e1c67-3c14-421d-81fa-16d411b41be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeca957e-61ed-4c3a-ab55-01e92647a392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeca957e-61ed-4c3a-ab55-01e92647a392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4752971a-6439-4d64-b995-25e46f5c1d2a', 'volume_name': 'volume-4752971a-6439-4d64-b995-25e46f5c1d2a', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1e460e-460d-409f-af97-3043dbf8cce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1e460e-460d-409f-af97-3043dbf8cce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db9cbd3-08c6-4acd-bfa4-5ecdb1aa498b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:51 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Volume 4752971a-6439-4d64-b995-25e46f5c1d2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4752971a-6439-4d64-b995-25e46f5c1d2a', 'volume_size': 1} Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1864160755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4752971a-6439-4d64-b995-25e46f5c1d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='297a9fe6c258483681826fe655e68594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:51Z,use_quota=True,user_id='7315c0abce26475995b72eda8a337831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Creating volume 4752971a-6439-4d64-b995-25e46f5c1d2a {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:34:51 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:51 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fefc3547-000d-40dc-a01d-964b778bccc7 tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.179s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-fefc3547-000d-40dc-a01d-964b778bccc7 tempest-VolumesGetTest-47319286 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:34:51 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a 1073741824 Jul 10 00:34:51 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-925d7f42-2b7e-4525-85f8-e9db3510b388 tempest-VolumesSnapshotTestJSON-1115347481 None] Lock "cinder-2142ba4f-b5a1-47aa-b103-d0a3c0f87379-delete_volume" released by "delete_volume" :: held 3.796s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:51 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-fefc3547-000d-40dc-a01d-964b778bccc7 tempest-VolumesGetTest-47319286 None] Deleted volume successfully. Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fefc3547-000d-40dc-a01d-964b778bccc7 tempest-VolumesGetTest-47319286 None] Lock "cinder-89467ec7-b94c-4633-bd0e-07c6d3a19ee1-delete_volume" released by "delete_volume" :: held 3.363s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:34:51 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_626a6173-a0b3-4812-858f-071225ab8b89_5ysugropdevstack@QuobyteHD" returned: 0 in 0.979s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] 626a6173-a0b3-4812-858f-071225ab8b89 was qcow2, converting to raw {{(pid=88119) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 00:34:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_626a6173-a0b3-4812-858f-071225ab8b89_5ysugropdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:51 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_626a6173-a0b3-4812-858f-071225ab8b89_5ysugropdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0 Jul 10 00:34:51 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:52 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a 1073741824" returned: 0 in 0.980s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:52 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a Jul 10 00:34:52 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:52 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a" returned: 0 in 0.794s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:34:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:34:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db9cbd3-08c6-4acd-bfa4-5ecdb1aa498b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4752971a-6439-4d64-b995-25e46f5c1d2a', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f8e812-eb12-4885-9c0f-37aa501c626e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:53 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Volume volume-4752971a-6439-4d64-b995-25e46f5c1d2a (4752971a-6439-4d64-b995-25e46f5c1d2a): created successfully Jul 10 00:34:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f8e812-eb12-4885-9c0f-37aa501c626e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Flow 'volume_create_manager' (a61ab3b7-2d87-435a-a7aa-f0f5053df49e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:53 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-5e2af149-3728-4740-b308-d94524450516 tempest-VolumesGetTest-47319286 None] Created volume successfully. Jul 10 00:34:53 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_626a6173-a0b3-4812-858f-071225ab8b89_5ysugropdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0" returned: 0 in 2.253s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:53 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_626a6173-a0b3-4812-858f-071225ab8b89_5ysugropdevstack@QuobyteHD, size 112.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0 {{(pid=88119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:34:53 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Converted 112.00 MB image at 49.68 MB/s Jul 10 00:34:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:53 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0 1G Jul 10 00:34:53 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:54 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0 1G" returned: 0 in 0.879s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:54 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae9717a-a484-4184-b846-c4cd94bc120f]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:54 devstack sudo[99754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0 Jul 10 00:34:54 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:54 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:34:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Flow 'volume_create_manager' (c54e2c26-0792-4687-ba93-ba9389d8dea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2762f294-deaf-45a7-b070-3f008092029d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2762f294-deaf-45a7-b070-3f008092029d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-161817359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbaee529-56f5-4fa7-ac4b-67189e2bf8f0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='297a9fe6c258483681826fe655e68594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4752971a-6439-4d64-b995-25e46f5c1d2a,status='creating',terminated_at=None,updated_at=2026-07-09T22:34:55Z,use_quota=True,user_id='7315c0abce26475995b72eda8a337831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4acfd2f-28bf-4730-95b9-321786c03cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4acfd2f-28bf-4730-95b9-321786c03cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (213f3339-632d-4b42-a1d2-44eed01efc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (213f3339-632d-4b42-a1d2-44eed01efc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fbaee529-56f5-4fa7-ac4b-67189e2bf8f0', 'volume_name': 'volume-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0', 'volume_size': 1, 'source_volid': '4752971a-6439-4d64-b995-25e46f5c1d2a', 'source_volstatus': 'available'}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1c5f30-3687-421e-8c38-0fb7d8112e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1c5f30-3687-421e-8c38-0fb7d8112e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfbdc0cc-d96b-40ff-bcc3-32cfd053bc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:55 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Volume fbaee529-56f5-4fa7-ac4b-67189e2bf8f0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0', 'volume_size': 1, 'source_volid': '4752971a-6439-4d64-b995-25e46f5c1d2a', 'source_volstatus': 'available'} Jul 10 00:34:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:34:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.003s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:34:55 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Cloning volume 4752971a-6439-4d64-b995-25e46f5c1d2a to volume fbaee529-56f5-4fa7-ac4b-67189e2bf8f0 Jul 10 00:34:55 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Creating offline snapshot 3e4051d3-d458-4406-922e-39ae5231ee3e of volume 4752971a-6439-4d64-b995-25e46f5c1d2a {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:34:55 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3e0de2-0f9e-4553-8ddf-4a442b7bc118]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:34:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:55 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a Jul 10 00:34:55 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:55 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0" returned: 0 in 1.234s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:55 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0 Jul 10 00:34:55 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:56 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a" returned: 0 in 1.359s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.3e4051d3-d458-4406-922e-39ae5231ee3e 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:56 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.3e4051d3-d458-4406-922e-39ae5231ee3e 1G Jul 10 00:34:56 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:56 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0" returned: 1 in 1.096s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:34:56 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Downloaded image 626a6173-a0b3-4812-858f-071225ab8b89 ((None, [{'url': 'file:///opt/stack/data/glance/images/626a6173-a0b3-4812-858f-071225ab8b89', 'metadata': {}}])) to volume 2d3fcfaa-0678-418a-a352-48050ddc33c0 successfully. {{(pid=88119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 00:34:56 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Temporary image 626a6173-a0b3-4812-858f-071225ab8b89 for user 992d3d88eafe45f48bd22fa85ebb899c is deleted. {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 00:34:56 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Marking volume 2d3fcfaa-0678-418a-a352-48050ddc33c0 as bootable. {{(pid=88119) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 00:34:56 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Copying metadata from image 626a6173-a0b3-4812-858f-071225ab8b89 to 2d3fcfaa-0678-418a-a352-48050ddc33c0. {{(pid=88119) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 00:34:56 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Creating volume glance metadata for volume 2d3fcfaa-0678-418a-a352-48050ddc33c0 backed by image 626a6173-a0b3-4812-858f-071225ab8b89 with: {'image_id': '626a6173-a0b3-4812-858f-071225ab8b89', 'image_name': 'tempest-scenario-img--343962359', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88119) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 00:34:57 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d5ee0de-2af5-40d6-8c3c-ad0beeea5dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d3fcfaa-0678-418a-a352-48050ddc33c0', 'volume_size': 1, 'image_id': '626a6173-a0b3-4812-858f-071225ab8b89', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/626a6173-a0b3-4812-858f-071225ab8b89', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--343962359', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bae3b3e7ce8547e7a487225d36d457f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '626a6173-a0b3-4812-858f-071225ab8b89', 'created_at': datetime.datetime(2026, 7, 9, 22, 34, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 34, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/626a6173-a0b3-4812-858f-071225ab8b89/file', 'properties': {}}, 'image_service': }' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:57 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04387bec-a4b8-48da-bc07-df27ca1baf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:34:57 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Volume volume-2d3fcfaa-0678-418a-a352-48050ddc33c0 (2d3fcfaa-0678-418a-a352-48050ddc33c0): created successfully Jul 10 00:34:57 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04387bec-a4b8-48da-bc07-df27ca1baf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:34:57 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Flow 'volume_create_manager' (b821de2d-26cb-42e0-97e2-497d725d5a22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:34:57 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-5468e520-c468-4fcd-b80b-d942e1b25679 tempest-TestInstancesWithCinderVolumes-493128608 None] Created volume successfully. Jul 10 00:34:57 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.3e4051d3-d458-4406-922e-39ae5231ee3e 1G" returned: 0 in 1.273s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4752971a-6439-4d64-b995-25e46f5c1d2a -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.3e4051d3-d458-4406-922e-39ae5231ee3e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:58 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4752971a-6439-4d64-b995-25e46f5c1d2a -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.3e4051d3-d458-4406-922e-39ae5231ee3e Jul 10 00:34:58 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:58 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4752971a-6439-4d64-b995-25e46f5c1d2a -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.3e4051d3-d458-4406-922e-39ae5231ee3e" returned: 0 in 0.911s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:58 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.3e4051d3-d458-4406-922e-39ae5231ee3e is being set with open permissions: ugo+rw Jul 10 00:34:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.3e4051d3-d458-4406-922e-39ae5231ee3e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:58 devstack sudo[99805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.3e4051d3-d458-4406-922e-39ae5231ee3e Jul 10 00:34:58 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:34:59 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root Jul 10 00:34:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.3e4051d3-d458-4406-922e-39ae5231ee3e" returned: 0 in 0.803s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:34:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:34:59 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.info Jul 10 00:34:59 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:00 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.info" returned: 0 in 0.790s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:00 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.info is being set with open permissions: ugo+rw Jul 10 00:35:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:00 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.info Jul 10 00:35:00 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:01 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.info" returned: 0 in 0.727s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:01 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Acquiring lock "cinder-quobyte-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0" by "_copy_volume_from_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:01 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Lock "cinder-quobyte-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:01 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] snapshot: 3e4051d3-d458-4406-922e-39ae5231ee3e, volume: fbaee529-56f5-4fa7-ac4b-67189e2bf8f0, {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 00:35:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:01 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:35:01 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:35:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:01 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[7257ac46-ae0b-450c-a625-7a698e770b42]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.3e4051d3-d458-4406-922e-39ae5231ee3e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:01 devstack sudo[99814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.3e4051d3-d458-4406-922e-39ae5231ee3e Jul 10 00:35:01 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:02 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.3e4051d3-d458-4406-922e-39ae5231ee3e" returned: 0 in 0.859s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4752971a-6439-4d64-b995-25e46f5c1d2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:35:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 00:35:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Creating direct copy from snapshot {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 00:35:02 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5d8a4d-880d-4cee-a05b-07406ca0885b]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:02 devstack sudo[99834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a Jul 10 00:35:02 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:03 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a" returned: 0 in 0.986s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:03 devstack cinder-volume[88119]: DEBUG cinder.utils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Path /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0 not found in is_blk_device check {{(pid=88119) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 00:35:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:03 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0 Jul 10 00:35:03 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-c3330dd6-39c4-4591-8bfb-79de503b0567 req-099f377c-771b-4079-9915-d636e03c6d0f tempest-TestInstancesWithCinderVolumes-493128608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:10 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0" returned: 0 in 7.692s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:10 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e915bbc9-f7ff-4ea6-82ed-adb74f9e1d40]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:11 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a Jul 10 00:35:11 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:12 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a" returned: 0 in 1.379s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:12 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Image conversion details: src /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a, size 1024.00 MB, duration 7.69 sec, destination /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0 {{(pid=88119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:35:12 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Converted 1024.00 MB image at 133.08 MB/s Jul 10 00:35:12 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0 is being set with open permissions: ugo+rw Jul 10 00:35:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:12 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0 Jul 10 00:35:12 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:13 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0" returned: 0 in 0.943s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:13 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Lock "cinder-quobyte-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0" released by "_copy_volume_from_snapshot" :: held 11.978s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:13 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:UPDATE=105,cinder:SELECT=72,cinder:INSERT=25,cinder:DELETE=8 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:35:13 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Acquiring lock "cinder-quobyte-3e4051d3-d458-4406-922e-39ae5231ee3e" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:13 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Lock "cinder-quobyte-3e4051d3-d458-4406-922e-39ae5231ee3e" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Deleting offline snapshot 3e4051d3-d458-4406-922e-39ae5231ee3e of volume 4752971a-6439-4d64-b995-25e46f5c1d2a {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:35:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] snapshot_file for this snap is: volume-4752971a-6439-4d64-b995-25e46f5c1d2a.3e4051d3-d458-4406-922e-39ae5231ee3e {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:35:13 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0474ec-e5af-4c13-a749-c03a8a0c4448]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.3e4051d3-d458-4406-922e-39ae5231ee3e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:13 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.3e4051d3-d458-4406-922e-39ae5231ee3e Jul 10 00:35:13 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:14 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f273582e-48c3-4913-b7f7-ec63ed615064 tempest-VolumesActionsTest-371201012 None] Acquiring lock "cinder-877b83e2-fe02-4161-b7ad-5b3ca510e214" by "attach_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:14 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:14 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f273582e-48c3-4913-b7f7-ec63ed615064 tempest-VolumesActionsTest-371201012 None] Lock "cinder-877b83e2-fe02-4161-b7ad-5b3ca510e214" acquired by "attach_volume" :: waited 0.202s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.3e4051d3-d458-4406-922e-39ae5231ee3e" returned: 0 in 1.437s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4752971a-6439-4d64-b995-25e46f5c1d2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:35:14 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=90,cinder:INSERT=32,cinder:DELETE=11,cinder:UPDATE=99 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:35:14 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d70a8a-f48b-4e02-89d0-95772981fa3f]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:15 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-f273582e-48c3-4913-b7f7-ec63ed615064 tempest-VolumesActionsTest-371201012 None] Attaching volume 877b83e2-fe02-4161-b7ad-5b3ca510e214 to instance 74653578-901c-40f6-b4f9-8a87658e7069 at mountpoint /dev/vdb on host None. Jul 10 00:35:15 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-f273582e-48c3-4913-b7f7-ec63ed615064 tempest-VolumesActionsTest-371201012 None] Attach volume completed successfully. Jul 10 00:35:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f273582e-48c3-4913-b7f7-ec63ed615064 tempest-VolumesActionsTest-371201012 None] Lock "cinder-877b83e2-fe02-4161-b7ad-5b3ca510e214" released by "attach_volume" :: held 0.331s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:15 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a Jul 10 00:35:15 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b02ccbb1-2d90-4fe2-aad5-f6d3b3e32ce8 tempest-VolumesActionsTest-371201012 None] Acquiring lock "cinder-877b83e2-fe02-4161-b7ad-5b3ca510e214-detach_volume" by "detach_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b02ccbb1-2d90-4fe2-aad5-f6d3b3e32ce8 tempest-VolumesActionsTest-371201012 None] Lock "cinder-877b83e2-fe02-4161-b7ad-5b3ca510e214-detach_volume" acquired by "detach_volume" :: waited 0.046s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:15 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-b02ccbb1-2d90-4fe2-aad5-f6d3b3e32ce8 tempest-VolumesActionsTest-371201012 None] Detaching volume 877b83e2-fe02-4161-b7ad-5b3ca510e214 from instance 74653578-901c-40f6-b4f9-8a87658e7069. Jul 10 00:35:16 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-b02ccbb1-2d90-4fe2-aad5-f6d3b3e32ce8 tempest-VolumesActionsTest-371201012 None] Detach volume completed successfully. Jul 10 00:35:16 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b02ccbb1-2d90-4fe2-aad5-f6d3b3e32ce8 tempest-VolumesActionsTest-371201012 None] Lock "cinder-877b83e2-fe02-4161-b7ad-5b3ca510e214-detach_volume" released by "detach_volume" :: held 0.213s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:16 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a" returned: 0 in 1.313s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.3e4051d3-d458-4406-922e-39ae5231ee3e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:16 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.3e4051d3-d458-4406-922e-39ae5231ee3e Jul 10 00:35:16 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:17 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.3e4051d3-d458-4406-922e-39ae5231ee3e" returned: 0 in 1.567s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.3e4051d3-d458-4406-922e-39ae5231ee3e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:17 devstack sudo[99973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.3e4051d3-d458-4406-922e-39ae5231ee3e Jul 10 00:35:17 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:18 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a.3e4051d3-d458-4406-922e-39ae5231ee3e" returned: 0 in 0.745s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:18 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Lock "cinder-quobyte-3e4051d3-d458-4406-922e-39ae5231ee3e" released by "_delete_snapshot" :: held 5.203s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 23.366s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-c3330dd6-39c4-4591-8bfb-79de503b0567 req-099f377c-771b-4079-9915-d636e03c6d0f tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.516s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:18 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfbdc0cc-d96b-40ff-bcc3-32cfd053bc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0', 'volume_size': 1, 'source_volid': '4752971a-6439-4d64-b995-25e46f5c1d2a', 'source_volstatus': 'available'}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:18 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20cd0f16-e41b-4e24-b734-61a3d9da3293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:18 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Volume volume-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0 (fbaee529-56f5-4fa7-ac4b-67189e2bf8f0): created successfully Jul 10 00:35:18 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20cd0f16-e41b-4e24-b734-61a3d9da3293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:18 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Flow 'volume_create_manager' (c54e2c26-0792-4687-ba93-ba9389d8dea9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:35:18 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e78224-8e54-47f3-9983-a49ad95f79bc]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-c3330dd6-39c4-4591-8bfb-79de503b0567 req-099f377c-771b-4079-9915-d636e03c6d0f tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:18 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-8af2e768-b522-4831-91bb-7390ae3591cf tempest-VolumesGetTest-47319286 None] Created volume successfully. Jul 10 00:35:18 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0 Jul 10 00:35:18 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:19 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-c3330dd6-39c4-4591-8bfb-79de503b0567 req-099f377c-771b-4079-9915-d636e03c6d0f tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0" returned: 0 in 1.292s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-c3330dd6-39c4-4591-8bfb-79de503b0567 req-099f377c-771b-4079-9915-d636e03c6d0f tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:20 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:35:20 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0 Jul 10 00:35:20 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Flow 'volume_create_manager' (d1063b35-9e3a-4787-8d3e-26899480b5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:35:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a8c4c5d-b2d8-4691-a29a-bac9e38deef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a8c4c5d-b2d8-4691-a29a-bac9e38deef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:35:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1215407273',display_name='tempest-VolumesGetTest-Volume-255651635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=711f3c48-8e47-4854-bbc5-beaaa0ccd62a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='297a9fe6c258483681826fe655e68594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:35:20Z,use_quota=True,user_id='7315c0abce26475995b72eda8a337831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195dc615-1b73-468e-8c66-7b86492c77ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (195dc615-1b73-468e-8c66-7b86492c77ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (463f06d1-7e54-4321-8f57-2537910f7049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (463f06d1-7e54-4321-8f57-2537910f7049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '711f3c48-8e47-4854-bbc5-beaaa0ccd62a', 'volume_name': 'volume-711f3c48-8e47-4854-bbc5-beaaa0ccd62a', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dfae87e-8e08-4066-8a8d-7cc2be9fcc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dfae87e-8e08-4066-8a8d-7cc2be9fcc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46997637-15f8-42d1-9ebe-51341492b311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:20 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Volume 711f3c48-8e47-4854-bbc5-beaaa0ccd62a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-711f3c48-8e47-4854-bbc5-beaaa0ccd62a', 'volume_size': 1} Jul 10 00:35:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:20 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-c3330dd6-39c4-4591-8bfb-79de503b0567 req-099f377c-771b-4079-9915-d636e03c6d0f tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0" returned: 1 in 0.844s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-c3330dd6-39c4-4591-8bfb-79de503b0567 req-099f377c-771b-4079-9915-d636e03c6d0f tempest-TestInstancesWithCinderVolumes-493128608 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:35:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-c3330dd6-39c4-4591-8bfb-79de503b0567 req-099f377c-771b-4079-9915-d636e03c6d0f tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.196s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.607s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:20 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:35:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1215407273',display_name='tempest-VolumesGetTest-Volume-255651635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=711f3c48-8e47-4854-bbc5-beaaa0ccd62a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='297a9fe6c258483681826fe655e68594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:35:20Z,use_quota=True,user_id='7315c0abce26475995b72eda8a337831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:35:20 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Creating volume 711f3c48-8e47-4854-bbc5-beaaa0ccd62a {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:35:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:20 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:35:20 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:35:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:20 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:35:20 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:35:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-711f3c48-8e47-4854-bbc5-beaaa0ccd62a 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:20 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-711f3c48-8e47-4854-bbc5-beaaa0ccd62a 1073741824 Jul 10 00:35:20 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-c3330dd6-39c4-4591-8bfb-79de503b0567 req-099f377c-771b-4079-9915-d636e03c6d0f tempest-TestInstancesWithCinderVolumes-493128608 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff', 'name': 'volume-2d3fcfaa-0678-418a-a352-48050ddc33c0', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '19f74348-d828-465a-88bb-f8d41eb01e46', 'enforce_multipath': True} {{(pid=88119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 10 00:35:21 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-c3330dd6-39c4-4591-8bfb-79de503b0567 req-099f377c-771b-4079-9915-d636e03c6d0f tempest-TestInstancesWithCinderVolumes-493128608 None] attachment_update completed successfully. Jul 10 00:35:21 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-711f3c48-8e47-4854-bbc5-beaaa0ccd62a 1073741824" returned: 0 in 0.984s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-711f3c48-8e47-4854-bbc5-beaaa0ccd62a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:21 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-711f3c48-8e47-4854-bbc5-beaaa0ccd62a Jul 10 00:35:21 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:22 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-711f3c48-8e47-4854-bbc5-beaaa0ccd62a" returned: 0 in 0.881s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:22 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:35:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.933s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46997637-15f8-42d1-9ebe-51341492b311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-711f3c48-8e47-4854-bbc5-beaaa0ccd62a', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7aec973-cc8f-453b-96c2-7a163d74a89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:22 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Volume volume-711f3c48-8e47-4854-bbc5-beaaa0ccd62a (711f3c48-8e47-4854-bbc5-beaaa0ccd62a): created successfully Jul 10 00:35:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7aec973-cc8f-453b-96c2-7a163d74a89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Flow 'volume_create_manager' (d1063b35-9e3a-4787-8d3e-26899480b5a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:35:22 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-8fd89a34-1e8c-4fe2-a67b-0701a685be08 tempest-VolumesGetTest-47319286 None] Created volume successfully. Jul 10 00:35:23 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25cce629-35bf-4b86-98a5-018c08b2d32c tempest-VolumesGetTest-47319286 None] Acquiring lock "cinder-711f3c48-8e47-4854-bbc5-beaaa0ccd62a-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:23 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25cce629-35bf-4b86-98a5-018c08b2d32c tempest-VolumesGetTest-47319286 None] Lock "cinder-711f3c48-8e47-4854-bbc5-beaaa0ccd62a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:23 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25cce629-35bf-4b86-98a5-018c08b2d32c tempest-VolumesGetTest-47319286 None] Acquiring lock "cinder-quobyte-711f3c48-8e47-4854-bbc5-beaaa0ccd62a" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:23 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25cce629-35bf-4b86-98a5-018c08b2d32c tempest-VolumesGetTest-47319286 None] Lock "cinder-quobyte-711f3c48-8e47-4854-bbc5-beaaa0ccd62a" acquired by "delete_volume" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:23 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[968d8728-6120-4ea4-8e4b-b4da0c0b1d4a]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25cce629-35bf-4b86-98a5-018c08b2d32c tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-711f3c48-8e47-4854-bbc5-beaaa0ccd62a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:23 devstack sudo[100088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-711f3c48-8e47-4854-bbc5-beaaa0ccd62a Jul 10 00:35:23 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:24 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25cce629-35bf-4b86-98a5-018c08b2d32c tempest-VolumesGetTest-47319286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-711f3c48-8e47-4854-bbc5-beaaa0ccd62a" returned: 0 in 1.218s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25cce629-35bf-4b86-98a5-018c08b2d32c tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-711f3c48-8e47-4854-bbc5-beaaa0ccd62a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:24 devstack sudo[100126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-711f3c48-8e47-4854-bbc5-beaaa0ccd62a Jul 10 00:35:24 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:25 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25cce629-35bf-4b86-98a5-018c08b2d32c tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-711f3c48-8e47-4854-bbc5-beaaa0ccd62a" returned: 0 in 0.893s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:25 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25cce629-35bf-4b86-98a5-018c08b2d32c tempest-VolumesGetTest-47319286 None] Lock "cinder-quobyte-711f3c48-8e47-4854-bbc5-beaaa0ccd62a" released by "delete_volume" :: held 2.166s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:25 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-25cce629-35bf-4b86-98a5-018c08b2d32c tempest-VolumesGetTest-47319286 None] Created reservations ['d8c5c10c-c454-4bd1-ab7d-ae77929f5f7c', '2ccbe995-9abb-4642-8ba9-ce6d53c67516', '3e36ea99-8fda-4eea-aaef-19d5217a66aa', 'd65626af-351e-4e97-91e6-b2aaae3a08eb'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:35:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-25cce629-35bf-4b86-98a5-018c08b2d32c tempest-VolumesGetTest-47319286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-25cce629-35bf-4b86-98a5-018c08b2d32c tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:25 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-25cce629-35bf-4b86-98a5-018c08b2d32c tempest-VolumesGetTest-47319286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:35:25 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-25cce629-35bf-4b86-98a5-018c08b2d32c tempest-VolumesGetTest-47319286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:35:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-25cce629-35bf-4b86-98a5-018c08b2d32c tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25cce629-35bf-4b86-98a5-018c08b2d32c tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:25 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:35:25 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1e186a8b-9c66-4297-93e8-a330ef2f1760 tempest-VolumesGetTest-47319286 None] Acquiring lock "cinder-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1e186a8b-9c66-4297-93e8-a330ef2f1760 tempest-VolumesGetTest-47319286 None] Lock "cinder-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:26 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-25cce629-35bf-4b86-98a5-018c08b2d32c tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.092s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:26 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-25cce629-35bf-4b86-98a5-018c08b2d32c tempest-VolumesGetTest-47319286 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:35:26 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-25cce629-35bf-4b86-98a5-018c08b2d32c tempest-VolumesGetTest-47319286 None] Deleted volume successfully. Jul 10 00:35:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1e186a8b-9c66-4297-93e8-a330ef2f1760 tempest-VolumesGetTest-47319286 None] Acquiring lock "cinder-quobyte-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-25cce629-35bf-4b86-98a5-018c08b2d32c tempest-VolumesGetTest-47319286 None] Lock "cinder-711f3c48-8e47-4854-bbc5-beaaa0ccd62a-delete_volume" released by "delete_volume" :: held 3.585s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1e186a8b-9c66-4297-93e8-a330ef2f1760 tempest-VolumesGetTest-47319286 None] Lock "cinder-quobyte-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0" acquired by "delete_volume" :: waited 0.021s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:27 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e3bf19-10e7-4ce8-8fea-7903991bbeea]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1e186a8b-9c66-4297-93e8-a330ef2f1760 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:27 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0 Jul 10 00:35:27 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:27 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1e186a8b-9c66-4297-93e8-a330ef2f1760 tempest-VolumesGetTest-47319286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0" returned: 0 in 0.967s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1e186a8b-9c66-4297-93e8-a330ef2f1760 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:28 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0 Jul 10 00:35:28 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:29 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1e186a8b-9c66-4297-93e8-a330ef2f1760 tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0" returned: 0 in 1.359s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:29 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1e186a8b-9c66-4297-93e8-a330ef2f1760 tempest-VolumesGetTest-47319286 None] Lock "cinder-quobyte-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0" released by "delete_volume" :: held 2.383s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:29 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-1e186a8b-9c66-4297-93e8-a330ef2f1760 tempest-VolumesGetTest-47319286 None] Created reservations ['ae0c490b-0bf8-41cf-91c9-0c3029c117b4', '57c17b4d-dbb7-41a4-b03d-fe574f9617b1', '6eb311bb-2a6e-433c-85a5-379e90853ede', '64eacd98-f64d-4c6c-aae7-2fce8b789795'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:35:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1e186a8b-9c66-4297-93e8-a330ef2f1760 tempest-VolumesGetTest-47319286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1e186a8b-9c66-4297-93e8-a330ef2f1760 tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:29 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1e186a8b-9c66-4297-93e8-a330ef2f1760 tempest-VolumesGetTest-47319286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:35:29 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1e186a8b-9c66-4297-93e8-a330ef2f1760 tempest-VolumesGetTest-47319286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:35:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1e186a8b-9c66-4297-93e8-a330ef2f1760 tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1e186a8b-9c66-4297-93e8-a330ef2f1760 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:29 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:35:29 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:30 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1e186a8b-9c66-4297-93e8-a330ef2f1760 tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.737s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:30 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-1e186a8b-9c66-4297-93e8-a330ef2f1760 tempest-VolumesGetTest-47319286 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:35:30 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-1e186a8b-9c66-4297-93e8-a330ef2f1760 tempest-VolumesGetTest-47319286 None] Deleted volume successfully. Jul 10 00:35:30 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8eee88ac-7547-43e2-9d31-6d4348205f82 tempest-VolumesGetTest-47319286 None] Acquiring lock "cinder-4752971a-6439-4d64-b995-25e46f5c1d2a-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:30 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1e186a8b-9c66-4297-93e8-a330ef2f1760 tempest-VolumesGetTest-47319286 None] Lock "cinder-fbaee529-56f5-4fa7-ac4b-67189e2bf8f0-delete_volume" released by "delete_volume" :: held 3.449s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:30 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8eee88ac-7547-43e2-9d31-6d4348205f82 tempest-VolumesGetTest-47319286 None] Lock "cinder-4752971a-6439-4d64-b995-25e46f5c1d2a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:30 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8eee88ac-7547-43e2-9d31-6d4348205f82 tempest-VolumesGetTest-47319286 None] Acquiring lock "cinder-quobyte-4752971a-6439-4d64-b995-25e46f5c1d2a" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:30 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8eee88ac-7547-43e2-9d31-6d4348205f82 tempest-VolumesGetTest-47319286 None] Lock "cinder-quobyte-4752971a-6439-4d64-b995-25e46f5c1d2a" acquired by "delete_volume" :: waited 0.020s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:30 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[365256e1-c985-4ab7-8ee6-52248713ade4]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8eee88ac-7547-43e2-9d31-6d4348205f82 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:30 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a Jul 10 00:35:30 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:35:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:35:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:35:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:31 devstack sudo[100495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:35:31 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:32 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8eee88ac-7547-43e2-9d31-6d4348205f82 tempest-VolumesGetTest-47319286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a" returned: 0 in 1.525s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8eee88ac-7547-43e2-9d31-6d4348205f82 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:32 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a Jul 10 00:35:32 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:33 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.739s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:33 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:35:33 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:35:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 29 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:35:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:35:33 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8eee88ac-7547-43e2-9d31-6d4348205f82 tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4752971a-6439-4d64-b995-25e46f5c1d2a" returned: 0 in 1.671s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:33 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8eee88ac-7547-43e2-9d31-6d4348205f82 tempest-VolumesGetTest-47319286 None] Lock "cinder-quobyte-4752971a-6439-4d64-b995-25e46f5c1d2a" released by "delete_volume" :: held 3.334s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:33 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-8eee88ac-7547-43e2-9d31-6d4348205f82 tempest-VolumesGetTest-47319286 None] Created reservations ['4e674315-2c18-4440-ae74-636559c27bcf', 'd888dd7b-9138-4e5e-b296-4271736b601d', 'e1e1471d-af16-4919-a48d-84a10abe86e5', 'ef5ad9f3-bec3-4ccf-a684-83045febf062'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:35:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8eee88ac-7547-43e2-9d31-6d4348205f82 tempest-VolumesGetTest-47319286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8eee88ac-7547-43e2-9d31-6d4348205f82 tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8eee88ac-7547-43e2-9d31-6d4348205f82 tempest-VolumesGetTest-47319286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:35:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8eee88ac-7547-43e2-9d31-6d4348205f82 tempest-VolumesGetTest-47319286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:35:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8eee88ac-7547-43e2-9d31-6d4348205f82 tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8eee88ac-7547-43e2-9d31-6d4348205f82 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:34 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:35:34 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:35 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8eee88ac-7547-43e2-9d31-6d4348205f82 tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.468s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:35 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-8eee88ac-7547-43e2-9d31-6d4348205f82 tempest-VolumesGetTest-47319286 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:35:35 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-8eee88ac-7547-43e2-9d31-6d4348205f82 tempest-VolumesGetTest-47319286 None] Deleted volume successfully. Jul 10 00:35:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8eee88ac-7547-43e2-9d31-6d4348205f82 tempest-VolumesGetTest-47319286 None] Lock "cinder-4752971a-6439-4d64-b995-25e46f5c1d2a-delete_volume" released by "delete_volume" :: held 5.344s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:36 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:35:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Flow 'volume_create_manager' (34ae5fdd-8173-4c48-b0df-fddb0cb5b0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:35:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b848b4c-ae69-473c-93cc-9065045a4d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b848b4c-ae69-473c-93cc-9065045a4d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1670311576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be48c47f-6f33-4a3f-b7f0-a121ed7ef54a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='297a9fe6c258483681826fe655e68594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:35:37Z,use_quota=True,user_id='7315c0abce26475995b72eda8a337831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f369d1d4-b9eb-4a9c-8c8e-5481df6b1eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f369d1d4-b9eb-4a9c-8c8e-5481df6b1eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae84a01-3a39-47c3-9be8-2791d45e5f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:36 devstack cinder-volume[88119]: DEBUG cinder.image.glance [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Creating Keystone auth plugin from conf {{(pid=88119) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 00:35:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae84a01-3a39-47c3-9be8-2791d45e5f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'be48c47f-6f33-4a3f-b7f0-a121ed7ef54a', 'volume_name': 'volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a', 'volume_size': 1, 'image_id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a6d0c978-002e-4d46-ab92-a0880bff49c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9bf3eaae61a647cbbfcb8c7cdd60fe87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'created_at': datetime.datetime(2026, 7, 9, 22, 17, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 17, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a6d0c978-002e-4d46-ab92-a0880bff49c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04f5339-7a09-4372-afec-9a3adebc8aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04f5339-7a09-4372-afec-9a3adebc8aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab86eb1f-2283-412e-9b3d-5fce80b5ecd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:37 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Volume be48c47f-6f33-4a3f-b7f0-a121ed7ef54a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a', 'volume_size': 1, 'image_id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a6d0c978-002e-4d46-ab92-a0880bff49c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9bf3eaae61a647cbbfcb8c7cdd60fe87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'created_at': datetime.datetime(2026, 7, 9, 22, 17, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 17, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a6d0c978-002e-4d46-ab92-a0880bff49c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 00:35:37 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Trying to clone be48c47f-6f33-4a3f-b7f0-a121ed7ef54a from image a6d0c978-002e-4d46-ab92-a0880bff49c1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a6d0c978-002e-4d46-ab92-a0880bff49c1', 'metadata': {}}]). {{(pid=88119) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 00:35:37 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_h_yk4fq7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 00:35:37 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Image download 20.69 MB at 20.69 MB/s Jul 10 00:35:37 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea692c0-7aa1-4830-b27a-ea11957660d1]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_h_yk4fq7devstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:37 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_h_yk4fq7devstack@QuobyteHD Jul 10 00:35:37 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:38 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_h_yk4fq7devstack@QuobyteHD" returned: 0 in 1.206s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:39 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Temporary image a6d0c978-002e-4d46-ab92-a0880bff49c1 is fetched for user 7315c0abce26475995b72eda8a337831. {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 00:35:39 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f98fd0-9549-4218-90bf-681e63e43316]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_h_yk4fq7devstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:39 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_h_yk4fq7devstack@QuobyteHD Jul 10 00:35:39 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:40 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_h_yk4fq7devstack@QuobyteHD" returned: 0 in 1.102s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1670311576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be48c47f-6f33-4a3f-b7f0-a121ed7ef54a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='297a9fe6c258483681826fe655e68594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:35:37Z,use_quota=True,user_id='7315c0abce26475995b72eda8a337831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:35:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Creating volume be48c47f-6f33-4a3f-b7f0-a121ed7ef54a {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:35:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:35:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:35:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:35:40 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:35:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:40 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a 1073741824 Jul 10 00:35:40 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:41 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a 1073741824" returned: 0 in 1.472s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:41 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a Jul 10 00:35:41 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:42 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a" returned: 0 in 0.821s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:42 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] <== create_volume: return (2366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:35:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.375s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:42 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Attempting download of a6d0c978-002e-4d46-ab92-a0880bff49c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/a6d0c978-002e-4d46-ab92-a0880bff49c1', 'metadata': {}}])) to volume be48c47f-6f33-4a3f-b7f0-a121ed7ef54a. {{(pid=88119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 00:35:42 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d62c3e-83fc-4b0f-9bf8-e7c56222c1a0]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_q56twurp {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:42 devstack sudo[100659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_q56twurp Jul 10 00:35:42 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:44 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_q56twurp" returned: 0 in 2.032s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_q56twurp {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:44 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_q56twurp Jul 10 00:35:44 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-06a27dd0-82bd-479a-9054-648eb912fa0f tempest-VolumesActionsTest-371201012 None] Acquiring lock "cinder-877b83e2-fe02-4161-b7ad-5b3ca510e214" by "attach_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-06a27dd0-82bd-479a-9054-648eb912fa0f tempest-VolumesActionsTest-371201012 None] Lock "cinder-877b83e2-fe02-4161-b7ad-5b3ca510e214" acquired by "attach_volume" :: waited 0.047s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:45 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-06a27dd0-82bd-479a-9054-648eb912fa0f tempest-VolumesActionsTest-371201012 None] Attaching volume 877b83e2-fe02-4161-b7ad-5b3ca510e214 to instance c4ea3196-7091-48fc-a061-7db796e2a42e at mountpoint /dev/vdb on host None. Jul 10 00:35:46 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-06a27dd0-82bd-479a-9054-648eb912fa0f tempest-VolumesActionsTest-371201012 None] Attach volume completed successfully. Jul 10 00:35:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-06a27dd0-82bd-479a-9054-648eb912fa0f tempest-VolumesActionsTest-371201012 None] Lock "cinder-877b83e2-fe02-4161-b7ad-5b3ca510e214" released by "attach_volume" :: held 0.200s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:46 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_q56twurp" returned: 1 in 1.553s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_q56twurp' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:35:46 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6858f2-1a47-4eb7-989b-5dc08a77ea6e]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_h_yk4fq7devstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:46 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_h_yk4fq7devstack@QuobyteHD Jul 10 00:35:46 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1961fe8e-7331-4910-8378-078aa5de1d70 tempest-VolumesActionsTest-371201012 None] Acquiring lock "cinder-877b83e2-fe02-4161-b7ad-5b3ca510e214-detach_volume" by "detach_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1961fe8e-7331-4910-8378-078aa5de1d70 tempest-VolumesActionsTest-371201012 None] Lock "cinder-877b83e2-fe02-4161-b7ad-5b3ca510e214-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:46 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-1961fe8e-7331-4910-8378-078aa5de1d70 tempest-VolumesActionsTest-371201012 None] Detaching volume 877b83e2-fe02-4161-b7ad-5b3ca510e214 from instance c4ea3196-7091-48fc-a061-7db796e2a42e. Jul 10 00:35:46 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-1961fe8e-7331-4910-8378-078aa5de1d70 tempest-VolumesActionsTest-371201012 None] Detach volume completed successfully. Jul 10 00:35:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1961fe8e-7331-4910-8378-078aa5de1d70 tempest-VolumesActionsTest-371201012 None] Lock "cinder-877b83e2-fe02-4161-b7ad-5b3ca510e214-detach_volume" released by "detach_volume" :: held 0.098s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:47 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_h_yk4fq7devstack@QuobyteHD" returned: 0 in 1.167s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:47 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] a6d0c978-002e-4d46-ab92-a0880bff49c1 was qcow2, converting to raw {{(pid=88119) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 00:35:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_h_yk4fq7devstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:47 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_h_yk4fq7devstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a Jul 10 00:35:47 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:49 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_h_yk4fq7devstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a" returned: 0 in 2.206s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:49 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_h_yk4fq7devstack@QuobyteHD, size 112.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a {{(pid=88119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:35:49 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Converted 112.00 MB image at 50.76 MB/s Jul 10 00:35:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:49 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a 1G Jul 10 00:35:49 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:50 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a 1G" returned: 0 in 1.068s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:50 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28e39fb-1b2e-4f1d-b748-130244197a26]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:50 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a Jul 10 00:35:50 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:51 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a" returned: 0 in 0.832s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:51 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a Jul 10 00:35:51 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:52 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a" returned: 1 in 0.817s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:35:52 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Downloaded image a6d0c978-002e-4d46-ab92-a0880bff49c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/a6d0c978-002e-4d46-ab92-a0880bff49c1', 'metadata': {}}])) to volume be48c47f-6f33-4a3f-b7f0-a121ed7ef54a successfully. {{(pid=88119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 00:35:52 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Temporary image a6d0c978-002e-4d46-ab92-a0880bff49c1 for user 7315c0abce26475995b72eda8a337831 is deleted. {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 00:35:52 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Marking volume be48c47f-6f33-4a3f-b7f0-a121ed7ef54a as bootable. {{(pid=88119) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 00:35:52 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Copying metadata from image a6d0c978-002e-4d46-ab92-a0880bff49c1 to be48c47f-6f33-4a3f-b7f0-a121ed7ef54a. {{(pid=88119) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 00:35:52 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Creating volume glance metadata for volume be48c47f-6f33-4a3f-b7f0-a121ed7ef54a backed by image a6d0c978-002e-4d46-ab92-a0880bff49c1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88119) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 00:35:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab86eb1f-2283-412e-9b3d-5fce80b5ecd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a', 'volume_size': 1, 'image_id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a6d0c978-002e-4d46-ab92-a0880bff49c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9bf3eaae61a647cbbfcb8c7cdd60fe87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'created_at': datetime.datetime(2026, 7, 9, 22, 17, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 17, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a6d0c978-002e-4d46-ab92-a0880bff49c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0566134-fd8e-4981-9db1-ac4332c7b749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:52 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Volume volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a (be48c47f-6f33-4a3f-b7f0-a121ed7ef54a): created successfully Jul 10 00:35:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0566134-fd8e-4981-9db1-ac4332c7b749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Flow 'volume_create_manager' (34ae5fdd-8173-4c48-b0df-fddb0cb5b0a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:35:52 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-608644d9-ec6a-46d1-b14b-7e0199504c96 tempest-VolumesGetTest-47319286 None] Created volume successfully. Jul 10 00:35:54 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:35:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Flow 'volume_create_manager' (73e456a5-04be-4c59-8d65-4b7a0500e97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:35:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71665f8-8f42-4aa2-81b2-6e32ec715395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71665f8-8f42-4aa2-81b2-6e32ec715395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:35:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1901618663',display_name='tempest-VolumesGetTest-Volume-362599506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a681509b-ea6d-488d-aa3e-649ad743c77e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='297a9fe6c258483681826fe655e68594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:35:54Z,use_quota=True,user_id='7315c0abce26475995b72eda8a337831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da30aef-bdbe-4741-bb4f-f3aa928a32fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da30aef-bdbe-4741-bb4f-f3aa928a32fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716316b8-535d-45a6-a25e-c1a7c07bb3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716316b8-535d-45a6-a25e-c1a7c07bb3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a681509b-ea6d-488d-aa3e-649ad743c77e', 'volume_name': 'volume-a681509b-ea6d-488d-aa3e-649ad743c77e', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925c1ee0-af3c-4533-b0a2-6b76a8ea8983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925c1ee0-af3c-4533-b0a2-6b76a8ea8983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa9d7c9-c51c-4114-ace1-353e193cb7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:54 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Volume a681509b-ea6d-488d-aa3e-649ad743c77e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a681509b-ea6d-488d-aa3e-649ad743c77e', 'volume_size': 1} Jul 10 00:35:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:35:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1901618663',display_name='tempest-VolumesGetTest-Volume-362599506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a681509b-ea6d-488d-aa3e-649ad743c77e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='297a9fe6c258483681826fe655e68594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:35:54Z,use_quota=True,user_id='7315c0abce26475995b72eda8a337831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:35:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Creating volume a681509b-ea6d-488d-aa3e-649ad743c77e {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:35:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:35:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:35:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:35:54 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:35:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a681509b-ea6d-488d-aa3e-649ad743c77e 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:54 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a681509b-ea6d-488d-aa3e-649ad743c77e 1073741824 Jul 10 00:35:54 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:55 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a681509b-ea6d-488d-aa3e-649ad743c77e 1073741824" returned: 0 in 1.118s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a681509b-ea6d-488d-aa3e-649ad743c77e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:55 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a681509b-ea6d-488d-aa3e-649ad743c77e Jul 10 00:35:55 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:56 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a681509b-ea6d-488d-aa3e-649ad743c77e" returned: 0 in 1.224s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] <== create_volume: return (2440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:35:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.445s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aa9d7c9-c51c-4114-ace1-353e193cb7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a681509b-ea6d-488d-aa3e-649ad743c77e', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b24f603-73a4-444d-b457-87132d85c0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:56 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Volume volume-a681509b-ea6d-488d-aa3e-649ad743c77e (a681509b-ea6d-488d-aa3e-649ad743c77e): created successfully Jul 10 00:35:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b24f603-73a4-444d-b457-87132d85c0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Flow 'volume_create_manager' (73e456a5-04be-4c59-8d65-4b7a0500e97c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:35:56 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-0427c6f5-9613-4493-a1ff-b204b5a778bf tempest-VolumesGetTest-47319286 None] Created volume successfully. Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Flow 'volume_create_manager' (df678432-5919-4160-b82e-8fc54d28e6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (386ea7b3-4255-456b-a332-0d01eef0cb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (386ea7b3-4255-456b-a332-0d01eef0cb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1002010221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3b5468-7a64-4333-92e5-9ee3a76c88f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b572b1acc6b49949c374944a590f136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:35:57Z,use_quota=True,user_id='d79a639b3f2140b3af99ca72a9793a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358fb475-ebd7-4b5b-b471-fd764ca0e7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358fb475-ebd7-4b5b-b471-fd764ca0e7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca58a68-e94f-43ef-ac2d-1d952e11a67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca58a68-e94f-43ef-ac2d-1d952e11a67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c3b5468-7a64-4333-92e5-9ee3a76c88f7', 'volume_name': 'volume-2c3b5468-7a64-4333-92e5-9ee3a76c88f7', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b4fb00-1634-4700-890e-5a6569dce7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b4fb00-1634-4700-890e-5a6569dce7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (887e6dca-a3be-4ccc-b51d-5fb76b1886e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:57 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Volume 2c3b5468-7a64-4333-92e5-9ee3a76c88f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c3b5468-7a64-4333-92e5-9ee3a76c88f7', 'volume_size': 1} Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1002010221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3b5468-7a64-4333-92e5-9ee3a76c88f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b572b1acc6b49949c374944a590f136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:35:57Z,use_quota=True,user_id='d79a639b3f2140b3af99ca72a9793a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Creating volume 2c3b5468-7a64-4333-92e5-9ee3a76c88f7 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:35:57 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2c3b5468-7a64-4333-92e5-9ee3a76c88f7 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3a3c0853-05e1-4a80-9341-45d8aa173e58 tempest-VolumesGetTest-47319286 None] Acquiring lock "cinder-a681509b-ea6d-488d-aa3e-649ad743c77e-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:57 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2c3b5468-7a64-4333-92e5-9ee3a76c88f7 1073741824 Jul 10 00:35:57 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3a3c0853-05e1-4a80-9341-45d8aa173e58 tempest-VolumesGetTest-47319286 None] Lock "cinder-a681509b-ea6d-488d-aa3e-649ad743c77e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3a3c0853-05e1-4a80-9341-45d8aa173e58 tempest-VolumesGetTest-47319286 None] Acquiring lock "cinder-quobyte-a681509b-ea6d-488d-aa3e-649ad743c77e" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9045df51-ee2f-48bf-8a8b-73b29ffecc97 tempest-VolumesActionsTest-371201012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3a3c0853-05e1-4a80-9341-45d8aa173e58 tempest-VolumesGetTest-47319286 None] Lock "cinder-quobyte-a681509b-ea6d-488d-aa3e-649ad743c77e" acquired by "delete_volume" :: waited 0.038s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab301e7-acb0-469e-a8f7-c164e409de01]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3a3c0853-05e1-4a80-9341-45d8aa173e58 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a681509b-ea6d-488d-aa3e-649ad743c77e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:57 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a681509b-ea6d-488d-aa3e-649ad743c77e Jul 10 00:35:57 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:58 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2c3b5468-7a64-4333-92e5-9ee3a76c88f7 1073741824" returned: 0 in 0.962s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2c3b5468-7a64-4333-92e5-9ee3a76c88f7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:58 devstack sudo[100957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2c3b5468-7a64-4333-92e5-9ee3a76c88f7 Jul 10 00:35:58 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:58 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3a3c0853-05e1-4a80-9341-45d8aa173e58 tempest-VolumesGetTest-47319286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a681509b-ea6d-488d-aa3e-649ad743c77e" returned: 0 in 1.019s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3a3c0853-05e1-4a80-9341-45d8aa173e58 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a681509b-ea6d-488d-aa3e-649ad743c77e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:58 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a681509b-ea6d-488d-aa3e-649ad743c77e Jul 10 00:35:58 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-f9c5cf84-5db9-4bd9-a3e2-853a3fe0d709 req-5ae493b3-ac2a-4fc8-9e66-c1bdd362479b tempest-TestInstancesWithCinderVolumes-493128608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:59 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2c3b5468-7a64-4333-92e5-9ee3a76c88f7" returned: 0 in 0.809s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:59 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:35:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9045df51-ee2f-48bf-8a8b-73b29ffecc97 tempest-VolumesActionsTest-371201012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.680s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (887e6dca-a3be-4ccc-b51d-5fb76b1886e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c3b5468-7a64-4333-92e5-9ee3a76c88f7', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd4d2a0-e4cf-4418-9379-bef12c7e9b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:35:59 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[43844702-018f-4100-883c-4552487c6ec2]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:35:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9045df51-ee2f-48bf-8a8b-73b29ffecc97 tempest-VolumesActionsTest-371201012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:59 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Jul 10 00:35:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3a3c0853-05e1-4a80-9341-45d8aa173e58 tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a681509b-ea6d-488d-aa3e-649ad743c77e" returned: 0 in 0.701s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:35:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3a3c0853-05e1-4a80-9341-45d8aa173e58 tempest-VolumesGetTest-47319286 None] Lock "cinder-quobyte-a681509b-ea6d-488d-aa3e-649ad743c77e" released by "delete_volume" :: held 1.771s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:35:59 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Volume volume-2c3b5468-7a64-4333-92e5-9ee3a76c88f7 (2c3b5468-7a64-4333-92e5-9ee3a76c88f7): created successfully Jul 10 00:35:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd4d2a0-e4cf-4418-9379-bef12c7e9b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:35:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Flow 'volume_create_manager' (df678432-5919-4160-b82e-8fc54d28e6fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:35:59 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-d763ffc5-29d1-49b3-b42d-baf708eaebad tempest-TestMinimumBasicScenario-98408840 None] Created volume successfully. Jul 10 00:35:59 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 Jul 10 00:35:59 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:59 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-3a3c0853-05e1-4a80-9341-45d8aa173e58 tempest-VolumesGetTest-47319286 None] Created reservations ['7230934f-488b-4c92-86d3-d6a180ba9e17', '13fc7145-ab47-4ee7-9208-4de60300023f', '090a3c5a-b623-48e9-ac69-35e328d7d1f7', '15b45df7-2b13-42e5-bd87-2509407adbf1'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:35:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3a3c0853-05e1-4a80-9341-45d8aa173e58 tempest-VolumesGetTest-47319286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:35:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3a3c0853-05e1-4a80-9341-45d8aa173e58 tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:35:59 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-3a3c0853-05e1-4a80-9341-45d8aa173e58 tempest-VolumesGetTest-47319286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:35:59 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-3a3c0853-05e1-4a80-9341-45d8aa173e58 tempest-VolumesGetTest-47319286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:35:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3a3c0853-05e1-4a80-9341-45d8aa173e58 tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:35:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3a3c0853-05e1-4a80-9341-45d8aa173e58 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:35:59 devstack sudo[100974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:35:59 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:35:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-de05da56-6240-49e5-a05e-5993d6616945 tempest-VolumesGetTest-47319286 None] Acquiring lock "cinder-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:35:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-de05da56-6240-49e5-a05e-5993d6616945 tempest-VolumesGetTest-47319286 None] Lock "cinder-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:35:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-de05da56-6240-49e5-a05e-5993d6616945 tempest-VolumesGetTest-47319286 None] Acquiring lock "cinder-quobyte-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-de05da56-6240-49e5-a05e-5993d6616945 tempest-VolumesGetTest-47319286 None] Lock "cinder-quobyte-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a" acquired by "delete_volume" :: waited 0.026s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:00 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b500d735-457f-4eb2-bef0-4372d7650243]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-de05da56-6240-49e5-a05e-5993d6616945 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:00 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a Jul 10 00:36:00 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:00 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9045df51-ee2f-48bf-8a8b-73b29ffecc97 tempest-VolumesActionsTest-371201012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214" returned: 0 in 0.942s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:00 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2cb71e-376b-485c-b5c2-ee4277a31916]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9045df51-ee2f-48bf-8a8b-73b29ffecc97 tempest-VolumesActionsTest-371201012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:00 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 Jul 10 00:36:00 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:00 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3a3c0853-05e1-4a80-9341-45d8aa173e58 tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.019s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:00 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-3a3c0853-05e1-4a80-9341-45d8aa173e58 tempest-VolumesGetTest-47319286 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:36:00 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-3a3c0853-05e1-4a80-9341-45d8aa173e58 tempest-VolumesGetTest-47319286 None] Deleted volume successfully. Jul 10 00:36:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3a3c0853-05e1-4a80-9341-45d8aa173e58 tempest-VolumesGetTest-47319286 None] Lock "cinder-a681509b-ea6d-488d-aa3e-649ad743c77e-delete_volume" released by "delete_volume" :: held 3.175s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:01 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-de05da56-6240-49e5-a05e-5993d6616945 tempest-VolumesGetTest-47319286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a" returned: 0 in 1.105s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-de05da56-6240-49e5-a05e-5993d6616945 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:01 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:01 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a Jul 10 00:36:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9045df51-ee2f-48bf-8a8b-73b29ffecc97 tempest-VolumesActionsTest-371201012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214" returned: 0 in 0.949s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:01 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9045df51-ee2f-48bf-8a8b-73b29ffecc97 tempest-VolumesActionsTest-371201012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 /opt/stack/data/cinder/conversion/877b83e2-fe02-4161-b7ad-5b3ca510e214.temp_image.ec05d549-505e-4627-a676-d83864748895jc7zfbgd.img {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:01 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 /opt/stack/data/cinder/conversion/877b83e2-fe02-4161-b7ad-5b3ca510e214.temp_image.ec05d549-505e-4627-a676-d83864748895jc7zfbgd.img Jul 10 00:36:01 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:01 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-de05da56-6240-49e5-a05e-5993d6616945 tempest-VolumesGetTest-47319286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a" returned: 1 in 0.798s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-de05da56-6240-49e5-a05e-5993d6616945 tempest-VolumesGetTest-47319286 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:36:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-de05da56-6240-49e5-a05e-5993d6616945 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:02 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a Jul 10 00:36:02 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:04 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-de05da56-6240-49e5-a05e-5993d6616945 tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a" returned: 0 in 2.613s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-de05da56-6240-49e5-a05e-5993d6616945 tempest-VolumesGetTest-47319286 None] Lock "cinder-quobyte-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a" released by "delete_volume" :: held 4.623s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:04 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-de05da56-6240-49e5-a05e-5993d6616945 tempest-VolumesGetTest-47319286 None] Created reservations ['dd266334-fb99-4572-856f-f5b86a4e544b', 'dbabcaa8-573a-4049-8eba-a8150242d54a', '9de47306-4e1e-4668-9f7b-2e1924f19119', '1749ca1f-e2d7-4006-b6e0-cc95007fbabf'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:36:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-de05da56-6240-49e5-a05e-5993d6616945 tempest-VolumesGetTest-47319286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-de05da56-6240-49e5-a05e-5993d6616945 tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-de05da56-6240-49e5-a05e-5993d6616945 tempest-VolumesGetTest-47319286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:36:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-de05da56-6240-49e5-a05e-5993d6616945 tempest-VolumesGetTest-47319286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:36:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-de05da56-6240-49e5-a05e-5993d6616945 tempest-VolumesGetTest-47319286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-de05da56-6240-49e5-a05e-5993d6616945 tempest-VolumesGetTest-47319286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:05 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:36:05 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-5119d65e-9959-439c-9453-b389fa0b3d47 req-70af75c4-e645-4b78-ad22-c98477b78c9e tempest-TestMinimumBasicScenario-98408840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:06 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-de05da56-6240-49e5-a05e-5993d6616945 tempest-VolumesGetTest-47319286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.622s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:06 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-de05da56-6240-49e5-a05e-5993d6616945 tempest-VolumesGetTest-47319286 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:36:06 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-de05da56-6240-49e5-a05e-5993d6616945 tempest-VolumesGetTest-47319286 None] Deleted volume successfully. Jul 10 00:36:06 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-de05da56-6240-49e5-a05e-5993d6616945 tempest-VolumesGetTest-47319286 None] Lock "cinder-be48c47f-6f33-4a3f-b7f0-a121ed7ef54a-delete_volume" released by "delete_volume" :: held 6.832s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:07 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9045df51-ee2f-48bf-8a8b-73b29ffecc97 tempest-VolumesActionsTest-371201012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 /opt/stack/data/cinder/conversion/877b83e2-fe02-4161-b7ad-5b3ca510e214.temp_image.ec05d549-505e-4627-a676-d83864748895jc7zfbgd.img" returned: 0 in 6.553s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:07 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[17525f85-2120-4c68-90df-33ffe0019ee9]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9045df51-ee2f-48bf-8a8b-73b29ffecc97 tempest-VolumesActionsTest-371201012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:07 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 Jul 10 00:36:07 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:08 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9045df51-ee2f-48bf-8a8b-73b29ffecc97 tempest-VolumesActionsTest-371201012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214" returned: 0 in 0.991s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:08 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-9045df51-ee2f-48bf-8a8b-73b29ffecc97 tempest-VolumesActionsTest-371201012 None] Image conversion details: src /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214, size 1024.00 MB, duration 6.55 sec, destination /opt/stack/data/cinder/conversion/877b83e2-fe02-4161-b7ad-5b3ca510e214.temp_image.ec05d549-505e-4627-a676-d83864748895jc7zfbgd.img {{(pid=88119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:36:08 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-9045df51-ee2f-48bf-8a8b-73b29ffecc97 tempest-VolumesActionsTest-371201012 None] Converted 1024.00 MB image at 156.25 MB/s Jul 10 00:36:08 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-9045df51-ee2f-48bf-8a8b-73b29ffecc97 tempest-VolumesActionsTest-371201012 None] ec05d549-505e-4627-a676-d83864748895 was raw, no need to convert to raw {{(pid=88119) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 10 00:36:16 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=62,cinder:INSERT=20,cinder:UPDATE=64,cinder:DELETE=4 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:36:18 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:INSERT=22,cinder:SELECT=63,cinder:UPDATE=65,cinder:DELETE=6 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:36:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9045df51-ee2f-48bf-8a8b-73b29ffecc97 tempest-VolumesActionsTest-371201012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.823s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-9045df51-ee2f-48bf-8a8b-73b29ffecc97 tempest-VolumesActionsTest-371201012 None] Uploaded volume to glance image-id: ec05d549-505e-4627-a676-d83864748895. {{(pid=88119) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 10 00:36:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-f9c5cf84-5db9-4bd9-a3e2-853a3fe0d709 req-5ae493b3-ac2a-4fc8-9e66-c1bdd362479b tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 28.926s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:28 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33ec83a-77f5-4433-9835-7c5b16b194ae]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-f9c5cf84-5db9-4bd9-a3e2-853a3fe0d709 req-5ae493b3-ac2a-4fc8-9e66-c1bdd362479b tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f811c93-ab5c-4d73-8fba-bdd03a057daf {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:28 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-9045df51-ee2f-48bf-8a8b-73b29ffecc97 tempest-VolumesActionsTest-371201012 None] Copy volume to image completed successfully. Jul 10 00:36:28 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f811c93-ab5c-4d73-8fba-bdd03a057daf Jul 10 00:36:28 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:28 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-f9c5cf84-5db9-4bd9-a3e2-853a3fe0d709 req-5ae493b3-ac2a-4fc8-9e66-c1bdd362479b tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f811c93-ab5c-4d73-8fba-bdd03a057daf" returned: 0 in 0.741s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-f9c5cf84-5db9-4bd9-a3e2-853a3fe0d709 req-5ae493b3-ac2a-4fc8-9e66-c1bdd362479b tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.762s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-5119d65e-9959-439c-9453-b389fa0b3d47 req-70af75c4-e645-4b78-ad22-c98477b78c9e tempest-TestMinimumBasicScenario-98408840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 23.235s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:28 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[783794a6-d9c1-4d7e-9bcf-e41befdd39d4]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-5119d65e-9959-439c-9453-b389fa0b3d47 req-70af75c4-e645-4b78-ad22-c98477b78c9e tempest-TestMinimumBasicScenario-98408840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2c3b5468-7a64-4333-92e5-9ee3a76c88f7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-f9c5cf84-5db9-4bd9-a3e2-853a3fe0d709 req-5ae493b3-ac2a-4fc8-9e66-c1bdd362479b tempest-TestInstancesWithCinderVolumes-493128608 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff', 'name': 'volume-8f811c93-ab5c-4d73-8fba-bdd03a057daf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a0069ef-07ac-4e30-bb50-b2e831b53c8e', 'enforce_multipath': True} {{(pid=88119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 10 00:36:29 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-f9c5cf84-5db9-4bd9-a3e2-853a3fe0d709 req-5ae493b3-ac2a-4fc8-9e66-c1bdd362479b tempest-TestInstancesWithCinderVolumes-493128608 None] attachment_update completed successfully. Jul 10 00:36:29 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2c3b5468-7a64-4333-92e5-9ee3a76c88f7 Jul 10 00:36:29 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:29 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-5119d65e-9959-439c-9453-b389fa0b3d47 req-70af75c4-e645-4b78-ad22-c98477b78c9e tempest-TestMinimumBasicScenario-98408840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2c3b5468-7a64-4333-92e5-9ee3a76c88f7" returned: 0 in 0.777s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-5119d65e-9959-439c-9453-b389fa0b3d47 req-70af75c4-e645-4b78-ad22-c98477b78c9e tempest-TestMinimumBasicScenario-98408840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.795s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-5119d65e-9959-439c-9453-b389fa0b3d47 req-70af75c4-e645-4b78-ad22-c98477b78c9e tempest-TestMinimumBasicScenario-98408840 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff', 'name': 'volume-2c3b5468-7a64-4333-92e5-9ee3a76c88f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d2e0f19-156a-4743-ac74-128d902066be', 'enforce_multipath': True} {{(pid=88119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 10 00:36:29 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-5119d65e-9959-439c-9453-b389fa0b3d47 req-70af75c4-e645-4b78-ad22-c98477b78c9e tempest-TestMinimumBasicScenario-98408840 None] attachment_update completed successfully. Jul 10 00:36:30 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:36:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Flow 'volume_create_manager' (a9d7980d-0711-46da-8d3d-1ddff39ce3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:36:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b9a421-a97d-4189-8dda-3296145a351d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b9a421-a97d-4189-8dda-3296145a351d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1465521062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8821d83-083b-4677-bd0b-f0235217d02e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d861582759cd436a9aa12372a555941d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:36:30Z,use_quota=True,user_id='8ace38f5c8c4470ebe4835736c0f251f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2b2f36-73c3-485d-ba20-4b02f7960c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2b2f36-73c3-485d-ba20-4b02f7960c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12efaa0e-2e52-40a7-8321-a66564c5d2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12efaa0e-2e52-40a7-8321-a66564c5d2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8821d83-083b-4677-bd0b-f0235217d02e', 'volume_name': 'volume-e8821d83-083b-4677-bd0b-f0235217d02e', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd68fcd-9de5-4725-a0a3-0d33acb61045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd68fcd-9de5-4725-a0a3-0d33acb61045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e4a3b1e-de2f-4d8c-9223-c6d5c540b31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:30 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Volume e8821d83-083b-4677-bd0b-f0235217d02e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8821d83-083b-4677-bd0b-f0235217d02e', 'volume_size': 1} Jul 10 00:36:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:30 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1465521062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8821d83-083b-4677-bd0b-f0235217d02e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d861582759cd436a9aa12372a555941d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:36:30Z,use_quota=True,user_id='8ace38f5c8c4470ebe4835736c0f251f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:36:30 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Creating volume e8821d83-083b-4677-bd0b-f0235217d02e {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:36:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:30 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:36:30 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:36:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:30 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:36:30 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:36:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e8821d83-083b-4677-bd0b-f0235217d02e 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:30 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e8821d83-083b-4677-bd0b-f0235217d02e 1073741824 Jul 10 00:36:30 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:31 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e8821d83-083b-4677-bd0b-f0235217d02e 1073741824" returned: 0 in 0.906s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e8821d83-083b-4677-bd0b-f0235217d02e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:31 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e8821d83-083b-4677-bd0b-f0235217d02e Jul 10 00:36:31 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:36:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:36:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:36:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:31 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:36:31 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:31 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e8821d83-083b-4677-bd0b-f0235217d02e" returned: 0 in 0.645s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:36:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.065s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e4a3b1e-de2f-4d8c-9223-c6d5c540b31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8821d83-083b-4677-bd0b-f0235217d02e', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d0acb0-05a0-4f72-a7b9-d1b8b6f56d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:31 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37259ed-7756-46c4-995f-27a7f107e2d0]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:31 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Volume volume-e8821d83-083b-4677-bd0b-f0235217d02e (e8821d83-083b-4677-bd0b-f0235217d02e): created successfully Jul 10 00:36:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d0acb0-05a0-4f72-a7b9-d1b8b6f56d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Flow 'volume_create_manager' (a9d7980d-0711-46da-8d3d-1ddff39ce3a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:36:32 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-7c523c77-edb9-4e7e-9aa0-30501a01309b tempest-VolumesListTestJSON-1086532669 None] Created volume successfully. Jul 10 00:36:32 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 Jul 10 00:36:32 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:32 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.670s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:32 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:36:32 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:36:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 29 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:36:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:36:32 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214" returned: 0 in 0.836s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:32 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4494cc4-bae1-4ce0-8495-6bb38c28191f]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:32 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 Jul 10 00:36:32 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:33 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:36:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Flow 'volume_create_manager' (403b7cd1-f727-4b25-a89f-343de156b087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:36:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c62fff2-11fb-4155-9d98-c26053e35897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c62fff2-11fb-4155-9d98-c26053e35897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1274113722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=713ab50e-263e-49c7-97eb-f51520ce1b32,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d861582759cd436a9aa12372a555941d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:36:33Z,use_quota=True,user_id='8ace38f5c8c4470ebe4835736c0f251f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414e53c5-5d70-4478-82cf-df4b60167a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414e53c5-5d70-4478-82cf-df4b60167a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6eafa4c-d62c-4919-9d03-d12061f0d7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6eafa4c-d62c-4919-9d03-d12061f0d7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '713ab50e-263e-49c7-97eb-f51520ce1b32', 'volume_name': 'volume-713ab50e-263e-49c7-97eb-f51520ce1b32', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ce84d9-f1a2-4e20-89e0-9ae211370764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ce84d9-f1a2-4e20-89e0-9ae211370764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31650566-825d-4eac-b1aa-4dcb34f4259a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:33 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Volume 713ab50e-263e-49c7-97eb-f51520ce1b32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-713ab50e-263e-49c7-97eb-f51520ce1b32', 'volume_size': 1} Jul 10 00:36:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:33 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214" returned: 0 in 0.805s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 /opt/stack/data/cinder/conversion/877b83e2-fe02-4161-b7ad-5b3ca510e214.temp_image.23c83742-00f0-4a5c-bf0a-6c9082b80c2ebtj46205.img {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:33 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 /opt/stack/data/cinder/conversion/877b83e2-fe02-4161-b7ad-5b3ca510e214.temp_image.23c83742-00f0-4a5c-bf0a-6c9082b80c2ebtj46205.img Jul 10 00:36:33 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-9c61b150-30bb-4706-a07f-f3e6615bc5bd req-ac023b37-6f6c-4efe-a34e-f136cf6e7b89 tempest-TestInstancesWithCinderVolumes-493128608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:38 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 /opt/stack/data/cinder/conversion/877b83e2-fe02-4161-b7ad-5b3ca510e214.temp_image.23c83742-00f0-4a5c-bf0a-6c9082b80c2ebtj46205.img" returned: 0 in 5.321s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:38 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3d435a-cfdc-4529-ac45-31531782ca7f]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:39 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 Jul 10 00:36:39 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:39 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214" returned: 0 in 0.945s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:39 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] Image conversion details: src /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214, size 1024.00 MB, duration 5.32 sec, destination /opt/stack/data/cinder/conversion/877b83e2-fe02-4161-b7ad-5b3ca510e214.temp_image.23c83742-00f0-4a5c-bf0a-6c9082b80c2ebtj46205.img {{(pid=88119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:36:39 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] Converted 1024.00 MB image at 192.38 MB/s Jul 10 00:36:39 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] 23c83742-00f0-4a5c-bf0a-6c9082b80c2e was raw, converting to qcow2 {{(pid=88119) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 10 00:36:39 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96c7ec0-0ffa-4588-aef2-09d1fbe36a27]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/877b83e2-fe02-4161-b7ad-5b3ca510e214.temp_image.23c83742-00f0-4a5c-bf0a-6c9082b80c2ebtj46205.img {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:40 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/877b83e2-fe02-4161-b7ad-5b3ca510e214.temp_image.23c83742-00f0-4a5c-bf0a-6c9082b80c2ebtj46205.img Jul 10 00:36:40 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:40 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/877b83e2-fe02-4161-b7ad-5b3ca510e214.temp_image.23c83742-00f0-4a5c-bf0a-6c9082b80c2ebtj46205.img" returned: 0 in 0.774s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/877b83e2-fe02-4161-b7ad-5b3ca510e214.temp_image.23c83742-00f0-4a5c-bf0a-6c9082b80c2ebtj46205.img {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:40 devstack sudo[101177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/877b83e2-fe02-4161-b7ad-5b3ca510e214.temp_image.23c83742-00f0-4a5c-bf0a-6c9082b80c2ebtj46205.img Jul 10 00:36:40 devstack sudo[101177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:41 devstack sudo[101177]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/877b83e2-fe02-4161-b7ad-5b3ca510e214.temp_image.23c83742-00f0-4a5c-bf0a-6c9082b80c2ebtj46205.img" returned: 1 in 0.770s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/877b83e2-fe02-4161-b7ad-5b3ca510e214.temp_image.23c83742-00f0-4a5c-bf0a-6c9082b80c2ebtj46205.img' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:36:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/877b83e2-fe02-4161-b7ad-5b3ca510e214.temp_image.23c83742-00f0-4a5c-bf0a-6c9082b80c2ebtj46205.img /opt/stack/data/cinder/conversion/vol_upload_ikfhq9uh {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:41 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/877b83e2-fe02-4161-b7ad-5b3ca510e214.temp_image.23c83742-00f0-4a5c-bf0a-6c9082b80c2ebtj46205.img /opt/stack/data/cinder/conversion/vol_upload_ikfhq9uh Jul 10 00:36:41 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:42 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/877b83e2-fe02-4161-b7ad-5b3ca510e214.temp_image.23c83742-00f0-4a5c-bf0a-6c9082b80c2ebtj46205.img /opt/stack/data/cinder/conversion/vol_upload_ikfhq9uh" returned: 0 in 0.975s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:42 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] Image conversion details: src /opt/stack/data/cinder/conversion/877b83e2-fe02-4161-b7ad-5b3ca510e214.temp_image.23c83742-00f0-4a5c-bf0a-6c9082b80c2ebtj46205.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ikfhq9uh {{(pid=88119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:36:42 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 10 00:36:42 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac68914a-a602-40ca-9d45-009a32404ffa]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ikfhq9uh {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:42 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ikfhq9uh Jul 10 00:36:42 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:43 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ikfhq9uh" returned: 0 in 0.799s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.691s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] Uploaded volume to glance image-id: 23c83742-00f0-4a5c-bf0a-6c9082b80c2e. {{(pid=88119) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 10 00:36:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.493s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1274113722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=713ab50e-263e-49c7-97eb-f51520ce1b32,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d861582759cd436a9aa12372a555941d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:36:33Z,use_quota=True,user_id='8ace38f5c8c4470ebe4835736c0f251f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:36:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Creating volume 713ab50e-263e-49c7-97eb-f51520ce1b32 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:36:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:36:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:36:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:36:44 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:36:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-713ab50e-263e-49c7-97eb-f51520ce1b32 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:44 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-713ab50e-263e-49c7-97eb-f51520ce1b32 1073741824 Jul 10 00:36:44 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:44 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-365e18cf-1a3a-4437-af79-842d9d0294e7 tempest-VolumesActionsTest-371201012 None] Copy volume to image completed successfully. Jul 10 00:36:45 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-713ab50e-263e-49c7-97eb-f51520ce1b32 1073741824" returned: 0 in 0.840s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-713ab50e-263e-49c7-97eb-f51520ce1b32 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:45 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-713ab50e-263e-49c7-97eb-f51520ce1b32 Jul 10 00:36:45 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:46 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-713ab50e-263e-49c7-97eb-f51520ce1b32" returned: 0 in 0.643s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:46 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:36:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-9c61b150-30bb-4706-a07f-f3e6615bc5bd req-ac023b37-6f6c-4efe-a34e-f136cf6e7b89 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.020s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1a527d68-716f-444b-8733-f60ffbf65a77 tempest-VolumesActionsTest-371201012 None] Acquiring lock "cinder-877b83e2-fe02-4161-b7ad-5b3ca510e214-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:46 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d9368d-bf18-478b-ac0e-9cd260f06b32]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-9c61b150-30bb-4706-a07f-f3e6615bc5bd req-ac023b37-6f6c-4efe-a34e-f136cf6e7b89 tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-048053d2-90d8-477c-9621-f7f892b68f14 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31650566-825d-4eac-b1aa-4dcb34f4259a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-713ab50e-263e-49c7-97eb-f51520ce1b32', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (821fd331-5ff9-4bd1-a723-1ac743ea6401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1a527d68-716f-444b-8733-f60ffbf65a77 tempest-VolumesActionsTest-371201012 None] Lock "cinder-877b83e2-fe02-4161-b7ad-5b3ca510e214-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:46 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Volume volume-713ab50e-263e-49c7-97eb-f51520ce1b32 (713ab50e-263e-49c7-97eb-f51520ce1b32): created successfully Jul 10 00:36:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (821fd331-5ff9-4bd1-a723-1ac743ea6401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Flow 'volume_create_manager' (403b7cd1-f727-4b25-a89f-343de156b087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:36:46 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-41d02215-5997-442d-ab76-6d44eb9a6dd4 tempest-VolumesListTestJSON-1086532669 None] Created volume successfully. Jul 10 00:36:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1a527d68-716f-444b-8733-f60ffbf65a77 tempest-VolumesActionsTest-371201012 None] Acquiring lock "cinder-quobyte-877b83e2-fe02-4161-b7ad-5b3ca510e214" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:46 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-048053d2-90d8-477c-9621-f7f892b68f14 Jul 10 00:36:46 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1a527d68-716f-444b-8733-f60ffbf65a77 tempest-VolumesActionsTest-371201012 None] Lock "cinder-quobyte-877b83e2-fe02-4161-b7ad-5b3ca510e214" acquired by "delete_volume" :: waited 0.024s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:46 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c53b9d6-1c78-459f-8e25-3e0c14e23dea]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1a527d68-716f-444b-8733-f60ffbf65a77 tempest-VolumesActionsTest-371201012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:46 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 Jul 10 00:36:46 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:47 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-9c61b150-30bb-4706-a07f-f3e6615bc5bd req-ac023b37-6f6c-4efe-a34e-f136cf6e7b89 tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-048053d2-90d8-477c-9621-f7f892b68f14" returned: 0 in 0.842s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-9c61b150-30bb-4706-a07f-f3e6615bc5bd req-ac023b37-6f6c-4efe-a34e-f136cf6e7b89 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.865s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-9c61b150-30bb-4706-a07f-f3e6615bc5bd req-ac023b37-6f6c-4efe-a34e-f136cf6e7b89 tempest-TestInstancesWithCinderVolumes-493128608 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff', 'name': 'volume-048053d2-90d8-477c-9621-f7f892b68f14', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1e06311-5543-422c-b842-619b3772a5cf', 'enforce_multipath': True} {{(pid=88119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 10 00:36:47 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-9c61b150-30bb-4706-a07f-f3e6615bc5bd req-ac023b37-6f6c-4efe-a34e-f136cf6e7b89 tempest-TestInstancesWithCinderVolumes-493128608 None] attachment_update completed successfully. Jul 10 00:36:47 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1a527d68-716f-444b-8733-f60ffbf65a77 tempest-VolumesActionsTest-371201012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214" returned: 0 in 0.811s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1a527d68-716f-444b-8733-f60ffbf65a77 tempest-VolumesActionsTest-371201012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:47 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214 Jul 10 00:36:47 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:47 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1a527d68-716f-444b-8733-f60ffbf65a77 tempest-VolumesActionsTest-371201012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-877b83e2-fe02-4161-b7ad-5b3ca510e214" returned: 0 in 0.649s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1a527d68-716f-444b-8733-f60ffbf65a77 tempest-VolumesActionsTest-371201012 None] Lock "cinder-quobyte-877b83e2-fe02-4161-b7ad-5b3ca510e214" released by "delete_volume" :: held 1.517s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:47 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-1a527d68-716f-444b-8733-f60ffbf65a77 tempest-VolumesActionsTest-371201012 None] Created reservations ['f20b8851-d8f8-40c4-a95c-50790c150e2e', '4b6c909f-1b7d-4a04-9583-a05eb22f4e1d', 'b5845123-b2c8-482a-a95c-1809ad7e816e', '38365437-5f9b-47e5-b505-102e3ea9402f'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:36:47 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:36:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Flow 'volume_create_manager' (827a6641-8d85-4d39-92d7-409267d3c537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:36:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625e44c5-1641-4580-b564-a3730daf2565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625e44c5-1641-4580-b564-a3730daf2565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-956451027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d8f1f2-5d03-4a41-84f4-c076556bdd19,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d861582759cd436a9aa12372a555941d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:36:48Z,use_quota=True,user_id='8ace38f5c8c4470ebe4835736c0f251f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e49c41-89be-471f-b62e-04bc43410654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e49c41-89be-471f-b62e-04bc43410654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57468c4e-0d11-4168-92fc-721a8ae7c6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57468c4e-0d11-4168-92fc-721a8ae7c6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7d8f1f2-5d03-4a41-84f4-c076556bdd19', 'volume_name': 'volume-f7d8f1f2-5d03-4a41-84f4-c076556bdd19', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55bce0ba-b8f1-494d-9f78-800a14a91df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55bce0ba-b8f1-494d-9f78-800a14a91df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc358392-2611-42e7-87ef-e0a3207fc993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:47 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Volume f7d8f1f2-5d03-4a41-84f4-c076556bdd19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7d8f1f2-5d03-4a41-84f4-c076556bdd19', 'volume_size': 1} Jul 10 00:36:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-956451027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d8f1f2-5d03-4a41-84f4-c076556bdd19,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d861582759cd436a9aa12372a555941d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:36:48Z,use_quota=True,user_id='8ace38f5c8c4470ebe4835736c0f251f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:36:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Creating volume f7d8f1f2-5d03-4a41-84f4-c076556bdd19 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:36:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:36:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:36:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:36:48 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:36:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f7d8f1f2-5d03-4a41-84f4-c076556bdd19 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:48 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f7d8f1f2-5d03-4a41-84f4-c076556bdd19 1073741824 Jul 10 00:36:48 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1a527d68-716f-444b-8733-f60ffbf65a77 tempest-VolumesActionsTest-371201012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1a527d68-716f-444b-8733-f60ffbf65a77 tempest-VolumesActionsTest-371201012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1a527d68-716f-444b-8733-f60ffbf65a77 tempest-VolumesActionsTest-371201012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:36:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1a527d68-716f-444b-8733-f60ffbf65a77 tempest-VolumesActionsTest-371201012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:36:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1a527d68-716f-444b-8733-f60ffbf65a77 tempest-VolumesActionsTest-371201012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1a527d68-716f-444b-8733-f60ffbf65a77 tempest-VolumesActionsTest-371201012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:48 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:36:48 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:48 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1a527d68-716f-444b-8733-f60ffbf65a77 tempest-VolumesActionsTest-371201012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.752s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:48 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-1a527d68-716f-444b-8733-f60ffbf65a77 tempest-VolumesActionsTest-371201012 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:36:48 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-1a527d68-716f-444b-8733-f60ffbf65a77 tempest-VolumesActionsTest-371201012 None] Deleted volume successfully. Jul 10 00:36:48 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1a527d68-716f-444b-8733-f60ffbf65a77 tempest-VolumesActionsTest-371201012 None] Lock "cinder-877b83e2-fe02-4161-b7ad-5b3ca510e214-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:49 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f7d8f1f2-5d03-4a41-84f4-c076556bdd19 1073741824" returned: 0 in 1.021s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f7d8f1f2-5d03-4a41-84f4-c076556bdd19 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:49 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f7d8f1f2-5d03-4a41-84f4-c076556bdd19 Jul 10 00:36:49 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:49 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f7d8f1f2-5d03-4a41-84f4-c076556bdd19" returned: 0 in 0.728s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:36:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc358392-2611-42e7-87ef-e0a3207fc993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7d8f1f2-5d03-4a41-84f4-c076556bdd19', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396157c6-a823-4e45-9a18-4d1792f6842b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:49 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Volume volume-f7d8f1f2-5d03-4a41-84f4-c076556bdd19 (f7d8f1f2-5d03-4a41-84f4-c076556bdd19): created successfully Jul 10 00:36:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396157c6-a823-4e45-9a18-4d1792f6842b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Flow 'volume_create_manager' (827a6641-8d85-4d39-92d7-409267d3c537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:36:49 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-eadd6257-2e5c-4390-9c48-c599aa07a26f tempest-VolumesListTestJSON-1086532669 None] Created volume successfully. Jul 10 00:36:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bddc1b1a-4218-46ae-a7d1-edf18753124e tempest-VolumesListTestJSON-1086532669 None] Acquiring lock "cinder-f7d8f1f2-5d03-4a41-84f4-c076556bdd19-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bddc1b1a-4218-46ae-a7d1-edf18753124e tempest-VolumesListTestJSON-1086532669 None] Lock "cinder-f7d8f1f2-5d03-4a41-84f4-c076556bdd19-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bddc1b1a-4218-46ae-a7d1-edf18753124e tempest-VolumesListTestJSON-1086532669 None] Acquiring lock "cinder-quobyte-f7d8f1f2-5d03-4a41-84f4-c076556bdd19" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bddc1b1a-4218-46ae-a7d1-edf18753124e tempest-VolumesListTestJSON-1086532669 None] Lock "cinder-quobyte-f7d8f1f2-5d03-4a41-84f4-c076556bdd19" acquired by "delete_volume" :: waited 0.032s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:52 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb08bad-6478-49b3-aae1-ca3db95aa825]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bddc1b1a-4218-46ae-a7d1-edf18753124e tempest-VolumesListTestJSON-1086532669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f7d8f1f2-5d03-4a41-84f4-c076556bdd19 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:52 devstack sudo[101278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f7d8f1f2-5d03-4a41-84f4-c076556bdd19 Jul 10 00:36:52 devstack sudo[101278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:53 devstack sudo[101278]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bddc1b1a-4218-46ae-a7d1-edf18753124e tempest-VolumesListTestJSON-1086532669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f7d8f1f2-5d03-4a41-84f4-c076556bdd19" returned: 0 in 1.078s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bddc1b1a-4218-46ae-a7d1-edf18753124e tempest-VolumesListTestJSON-1086532669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f7d8f1f2-5d03-4a41-84f4-c076556bdd19 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:53 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f7d8f1f2-5d03-4a41-84f4-c076556bdd19 Jul 10 00:36:53 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:54 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bddc1b1a-4218-46ae-a7d1-edf18753124e tempest-VolumesListTestJSON-1086532669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f7d8f1f2-5d03-4a41-84f4-c076556bdd19" returned: 0 in 0.814s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bddc1b1a-4218-46ae-a7d1-edf18753124e tempest-VolumesListTestJSON-1086532669 None] Lock "cinder-quobyte-f7d8f1f2-5d03-4a41-84f4-c076556bdd19" released by "delete_volume" :: held 1.952s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:54 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-bddc1b1a-4218-46ae-a7d1-edf18753124e tempest-VolumesListTestJSON-1086532669 None] Created reservations ['44833d5e-dd84-4b68-aff9-ec52890c0851', 'ef5c90b0-c979-46bb-9af0-09333bf305af', '16fb6191-7640-4ffb-8ac2-02120565eb16', 'dfca6d95-5854-4cf3-b357-a6207140d678'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:36:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-bddc1b1a-4218-46ae-a7d1-edf18753124e tempest-VolumesListTestJSON-1086532669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-bddc1b1a-4218-46ae-a7d1-edf18753124e tempest-VolumesListTestJSON-1086532669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-bddc1b1a-4218-46ae-a7d1-edf18753124e tempest-VolumesListTestJSON-1086532669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:36:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-bddc1b1a-4218-46ae-a7d1-edf18753124e tempest-VolumesListTestJSON-1086532669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:36:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-bddc1b1a-4218-46ae-a7d1-edf18753124e tempest-VolumesListTestJSON-1086532669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bddc1b1a-4218-46ae-a7d1-edf18753124e tempest-VolumesListTestJSON-1086532669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:54 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:36:54 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:55 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b22c99c7-a72e-4b86-bdef-2e29038f92b5 tempest-VolumesListTestJSON-1086532669 None] Acquiring lock "cinder-713ab50e-263e-49c7-97eb-f51520ce1b32-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:55 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b22c99c7-a72e-4b86-bdef-2e29038f92b5 tempest-VolumesListTestJSON-1086532669 None] Lock "cinder-713ab50e-263e-49c7-97eb-f51520ce1b32-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:55 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b22c99c7-a72e-4b86-bdef-2e29038f92b5 tempest-VolumesListTestJSON-1086532669 None] Acquiring lock "cinder-quobyte-713ab50e-263e-49c7-97eb-f51520ce1b32" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:55 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b22c99c7-a72e-4b86-bdef-2e29038f92b5 tempest-VolumesListTestJSON-1086532669 None] Lock "cinder-quobyte-713ab50e-263e-49c7-97eb-f51520ce1b32" acquired by "delete_volume" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:55 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[572f1a61-e7fc-47a3-a600-335cc82dbc16]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b22c99c7-a72e-4b86-bdef-2e29038f92b5 tempest-VolumesListTestJSON-1086532669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-713ab50e-263e-49c7-97eb-f51520ce1b32 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:55 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-713ab50e-263e-49c7-97eb-f51520ce1b32 Jul 10 00:36:55 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:55 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bddc1b1a-4218-46ae-a7d1-edf18753124e tempest-VolumesListTestJSON-1086532669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.941s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:55 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-bddc1b1a-4218-46ae-a7d1-edf18753124e tempest-VolumesListTestJSON-1086532669 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:36:55 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-bddc1b1a-4218-46ae-a7d1-edf18753124e tempest-VolumesListTestJSON-1086532669 None] Deleted volume successfully. Jul 10 00:36:56 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bddc1b1a-4218-46ae-a7d1-edf18753124e tempest-VolumesListTestJSON-1086532669 None] Lock "cinder-f7d8f1f2-5d03-4a41-84f4-c076556bdd19-delete_volume" released by "delete_volume" :: held 3.310s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:56 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:36:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Flow 'volume_create_manager' (bcbe81eb-b40a-410f-b20c-1ae667127a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:36:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f6b35e7-32e8-472f-bf22-0406d5d171e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f6b35e7-32e8-472f-bf22-0406d5d171e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2053593234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084c3b42-69bc-4745-811c-4238ce9f2513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5150bc20b2694ec18353552ce218d7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:36:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:36:56Z,use_quota=True,user_id='50a523ae7f7a4356965723f5ff32d349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b64a55c6-fe75-4cd3-a000-a10846fe9613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b64a55c6-fe75-4cd3-a000-a10846fe9613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4adc867-d2b3-4ea0-9e90-47f7e02f5161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4adc867-d2b3-4ea0-9e90-47f7e02f5161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '084c3b42-69bc-4745-811c-4238ce9f2513', 'volume_name': 'volume-084c3b42-69bc-4745-811c-4238ce9f2513', 'volume_size': 2}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054bd7c5-74cd-4975-ab22-f307186c0e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054bd7c5-74cd-4975-ab22-f307186c0e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c1532ae-2441-4a84-82b0-b83a80f5d165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:56 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Volume 084c3b42-69bc-4745-811c-4238ce9f2513: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-084c3b42-69bc-4745-811c-4238ce9f2513', 'volume_size': 2} Jul 10 00:36:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2053593234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084c3b42-69bc-4745-811c-4238ce9f2513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5150bc20b2694ec18353552ce218d7b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:36:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:36:56Z,use_quota=True,user_id='50a523ae7f7a4356965723f5ff32d349',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:36:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Creating volume 084c3b42-69bc-4745-811c-4238ce9f2513 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:36:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:36:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:36:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:36:56 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:36:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-084c3b42-69bc-4745-811c-4238ce9f2513 2147483648 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:56 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b22c99c7-a72e-4b86-bdef-2e29038f92b5 tempest-VolumesListTestJSON-1086532669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-713ab50e-263e-49c7-97eb-f51520ce1b32" returned: 0 in 1.061s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b22c99c7-a72e-4b86-bdef-2e29038f92b5 tempest-VolumesListTestJSON-1086532669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-713ab50e-263e-49c7-97eb-f51520ce1b32 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:56 devstack sudo[101314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-084c3b42-69bc-4745-811c-4238ce9f2513 2147483648 Jul 10 00:36:56 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:56 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-713ab50e-263e-49c7-97eb-f51520ce1b32 Jul 10 00:36:56 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:57 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b22c99c7-a72e-4b86-bdef-2e29038f92b5 tempest-VolumesListTestJSON-1086532669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-713ab50e-263e-49c7-97eb-f51520ce1b32" returned: 0 in 0.679s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:57 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b22c99c7-a72e-4b86-bdef-2e29038f92b5 tempest-VolumesListTestJSON-1086532669 None] Lock "cinder-quobyte-713ab50e-263e-49c7-97eb-f51520ce1b32" released by "delete_volume" :: held 1.802s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:57 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-b22c99c7-a72e-4b86-bdef-2e29038f92b5 tempest-VolumesListTestJSON-1086532669 None] Created reservations ['22053fea-f775-482c-80a4-d0d345e28d0f', 'cf359265-89c6-4817-9ac3-836609e550e9', '7a303fe8-baa9-4a1d-832f-141ab97e46c2', '7caf4197-6904-428e-a66c-7de7d85e614e'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:36:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b22c99c7-a72e-4b86-bdef-2e29038f92b5 tempest-VolumesListTestJSON-1086532669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b22c99c7-a72e-4b86-bdef-2e29038f92b5 tempest-VolumesListTestJSON-1086532669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:57 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b22c99c7-a72e-4b86-bdef-2e29038f92b5 tempest-VolumesListTestJSON-1086532669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:36:57 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b22c99c7-a72e-4b86-bdef-2e29038f92b5 tempest-VolumesListTestJSON-1086532669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:36:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b22c99c7-a72e-4b86-bdef-2e29038f92b5 tempest-VolumesListTestJSON-1086532669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b22c99c7-a72e-4b86-bdef-2e29038f92b5 tempest-VolumesListTestJSON-1086532669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:57 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:36:57 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:57 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-138f5ffa-71ab-4339-8dc6-cd5b1a9b98ee tempest-VolumesListTestJSON-1086532669 None] Acquiring lock "cinder-e8821d83-083b-4677-bd0b-f0235217d02e-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:57 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-138f5ffa-71ab-4339-8dc6-cd5b1a9b98ee tempest-VolumesListTestJSON-1086532669 None] Lock "cinder-e8821d83-083b-4677-bd0b-f0235217d02e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:57 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-084c3b42-69bc-4745-811c-4238ce9f2513 2147483648" returned: 0 in 1.286s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:57 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-138f5ffa-71ab-4339-8dc6-cd5b1a9b98ee tempest-VolumesListTestJSON-1086532669 None] Acquiring lock "cinder-quobyte-e8821d83-083b-4677-bd0b-f0235217d02e" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-084c3b42-69bc-4745-811c-4238ce9f2513 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:57 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-138f5ffa-71ab-4339-8dc6-cd5b1a9b98ee tempest-VolumesListTestJSON-1086532669 None] Lock "cinder-quobyte-e8821d83-083b-4677-bd0b-f0235217d02e" acquired by "delete_volume" :: waited 0.039s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:57 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38f4306-1402-4f6a-b510-07ad55e8e780]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-138f5ffa-71ab-4339-8dc6-cd5b1a9b98ee tempest-VolumesListTestJSON-1086532669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e8821d83-083b-4677-bd0b-f0235217d02e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:57 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-084c3b42-69bc-4745-811c-4238ce9f2513 Jul 10 00:36:57 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:57 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e8821d83-083b-4677-bd0b-f0235217d02e Jul 10 00:36:57 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:58 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b22c99c7-a72e-4b86-bdef-2e29038f92b5 tempest-VolumesListTestJSON-1086532669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.785s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:58 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-b22c99c7-a72e-4b86-bdef-2e29038f92b5 tempest-VolumesListTestJSON-1086532669 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:36:58 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-b22c99c7-a72e-4b86-bdef-2e29038f92b5 tempest-VolumesListTestJSON-1086532669 None] Deleted volume successfully. Jul 10 00:36:58 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b22c99c7-a72e-4b86-bdef-2e29038f92b5 tempest-VolumesListTestJSON-1086532669 None] Lock "cinder-713ab50e-263e-49c7-97eb-f51520ce1b32-delete_volume" released by "delete_volume" :: held 2.873s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:58 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-084c3b42-69bc-4745-811c-4238ce9f2513" returned: 0 in 0.744s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] <== create_volume: return (2111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:36:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.114s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:58 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c1532ae-2441-4a84-82b0-b83a80f5d165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-084c3b42-69bc-4745-811c-4238ce9f2513', 'volume_size': 2}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:58 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d336bac-41ed-48fa-b81e-92a8d6222962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:36:58 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Volume volume-084c3b42-69bc-4745-811c-4238ce9f2513 (084c3b42-69bc-4745-811c-4238ce9f2513): created successfully Jul 10 00:36:58 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d336bac-41ed-48fa-b81e-92a8d6222962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:36:58 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Flow 'volume_create_manager' (bcbe81eb-b40a-410f-b20c-1ae667127a79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:36:58 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-14442f84-2a72-4b1b-ae59-5ad0733ec750 tempest-VolumesCloneNegativeTest-1552286950 None] Created volume successfully. Jul 10 00:36:58 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-3b86dd1c-e8d7-4bf0-8c0e-27c23859602f req-c743654d-53a0-4106-b0e0-1371ca63529d tempest-TestInstancesWithCinderVolumes-493128608 None] Terminate volume connection completed successfully. Jul 10 00:36:58 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-3b86dd1c-e8d7-4bf0-8c0e-27c23859602f req-c743654d-53a0-4106-b0e0-1371ca63529d tempest-TestInstancesWithCinderVolumes-493128608 None] Deleting attachment 7a0069ef-07ac-4e30-bb50-b2e831b53c8e. {{(pid=88119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 10 00:36:58 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-138f5ffa-71ab-4339-8dc6-cd5b1a9b98ee tempest-VolumesListTestJSON-1086532669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e8821d83-083b-4677-bd0b-f0235217d02e" returned: 0 in 1.037s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-138f5ffa-71ab-4339-8dc6-cd5b1a9b98ee tempest-VolumesListTestJSON-1086532669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e8821d83-083b-4677-bd0b-f0235217d02e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:58 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e8821d83-083b-4677-bd0b-f0235217d02e Jul 10 00:36:58 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:59 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Jul 10 00:36:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-138f5ffa-71ab-4339-8dc6-cd5b1a9b98ee tempest-VolumesListTestJSON-1086532669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e8821d83-083b-4677-bd0b-f0235217d02e" returned: 0 in 0.788s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:36:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-138f5ffa-71ab-4339-8dc6-cd5b1a9b98ee tempest-VolumesListTestJSON-1086532669 None] Lock "cinder-quobyte-e8821d83-083b-4677-bd0b-f0235217d02e" released by "delete_volume" :: held 1.877s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:36:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2520ee63-378d-4ee1-816a-fd79e9c14f0e tempest-VolumesCloneNegativeTest-1552286950 None] Acquiring lock "cinder-084c3b42-69bc-4745-811c-4238ce9f2513-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2520ee63-378d-4ee1-816a-fd79e9c14f0e tempest-VolumesCloneNegativeTest-1552286950 None] Lock "cinder-084c3b42-69bc-4745-811c-4238ce9f2513-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:59 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-138f5ffa-71ab-4339-8dc6-cd5b1a9b98ee tempest-VolumesListTestJSON-1086532669 None] Created reservations ['f612cce9-29fd-4343-ae9b-c85c946c7881', '9686229f-9be5-452c-901d-2f4d06b426de', '8bc41612-3fce-412d-bf3d-b57af58b3ec9', '09e52e8e-e882-41a7-a0ec-90256865d609'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:36:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2520ee63-378d-4ee1-816a-fd79e9c14f0e tempest-VolumesCloneNegativeTest-1552286950 None] Acquiring lock "cinder-quobyte-084c3b42-69bc-4745-811c-4238ce9f2513" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:36:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2520ee63-378d-4ee1-816a-fd79e9c14f0e tempest-VolumesCloneNegativeTest-1552286950 None] Lock "cinder-quobyte-084c3b42-69bc-4745-811c-4238ce9f2513" acquired by "delete_volume" :: waited 0.027s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:36:59 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce5a435-02fc-409e-abd5-1a8893d1f449]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:36:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2520ee63-378d-4ee1-816a-fd79e9c14f0e tempest-VolumesCloneNegativeTest-1552286950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-084c3b42-69bc-4745-811c-4238ce9f2513 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-138f5ffa-71ab-4339-8dc6-cd5b1a9b98ee tempest-VolumesListTestJSON-1086532669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:36:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-138f5ffa-71ab-4339-8dc6-cd5b1a9b98ee tempest-VolumesListTestJSON-1086532669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:36:59 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-138f5ffa-71ab-4339-8dc6-cd5b1a9b98ee tempest-VolumesListTestJSON-1086532669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:36:59 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-138f5ffa-71ab-4339-8dc6-cd5b1a9b98ee tempest-VolumesListTestJSON-1086532669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:36:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-138f5ffa-71ab-4339-8dc6-cd5b1a9b98ee tempest-VolumesListTestJSON-1086532669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:36:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-138f5ffa-71ab-4339-8dc6-cd5b1a9b98ee tempest-VolumesListTestJSON-1086532669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:36:59 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:36:59 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:36:59 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-084c3b42-69bc-4745-811c-4238ce9f2513 Jul 10 00:36:59 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:00 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-138f5ffa-71ab-4339-8dc6-cd5b1a9b98ee tempest-VolumesListTestJSON-1086532669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.770s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:00 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-138f5ffa-71ab-4339-8dc6-cd5b1a9b98ee tempest-VolumesListTestJSON-1086532669 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:37:00 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-138f5ffa-71ab-4339-8dc6-cd5b1a9b98ee tempest-VolumesListTestJSON-1086532669 None] Deleted volume successfully. Jul 10 00:37:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-138f5ffa-71ab-4339-8dc6-cd5b1a9b98ee tempest-VolumesListTestJSON-1086532669 None] Lock "cinder-e8821d83-083b-4677-bd0b-f0235217d02e-delete_volume" released by "delete_volume" :: held 3.062s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:37:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-aa25bf78-6dfb-4fe0-82c6-29fae2e08277 tempest-TestInstancesWithCinderVolumes-493128608 None] Acquiring lock "cinder-8f811c93-ab5c-4d73-8fba-bdd03a057daf-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:37:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-aa25bf78-6dfb-4fe0-82c6-29fae2e08277 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "cinder-8f811c93-ab5c-4d73-8fba-bdd03a057daf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:37:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-aa25bf78-6dfb-4fe0-82c6-29fae2e08277 tempest-TestInstancesWithCinderVolumes-493128608 None] Acquiring lock "cinder-quobyte-8f811c93-ab5c-4d73-8fba-bdd03a057daf" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:37:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-aa25bf78-6dfb-4fe0-82c6-29fae2e08277 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "cinder-quobyte-8f811c93-ab5c-4d73-8fba-bdd03a057daf" acquired by "delete_volume" :: waited 0.032s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:37:00 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[df204237-c19c-4dcd-8783-ca58295b5e82]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:37:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-aa25bf78-6dfb-4fe0-82c6-29fae2e08277 tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f811c93-ab5c-4d73-8fba-bdd03a057daf {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:01 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2520ee63-378d-4ee1-816a-fd79e9c14f0e tempest-VolumesCloneNegativeTest-1552286950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-084c3b42-69bc-4745-811c-4238ce9f2513" returned: 0 in 1.280s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2520ee63-378d-4ee1-816a-fd79e9c14f0e tempest-VolumesCloneNegativeTest-1552286950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-084c3b42-69bc-4745-811c-4238ce9f2513 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:01 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-084c3b42-69bc-4745-811c-4238ce9f2513 Jul 10 00:37:01 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:01 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f811c93-ab5c-4d73-8fba-bdd03a057daf Jul 10 00:37:01 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:02 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-aa25bf78-6dfb-4fe0-82c6-29fae2e08277 tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f811c93-ab5c-4d73-8fba-bdd03a057daf" returned: 0 in 1.104s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-aa25bf78-6dfb-4fe0-82c6-29fae2e08277 tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f811c93-ab5c-4d73-8fba-bdd03a057daf {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:02 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f811c93-ab5c-4d73-8fba-bdd03a057daf Jul 10 00:37:02 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:02 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2520ee63-378d-4ee1-816a-fd79e9c14f0e tempest-VolumesCloneNegativeTest-1552286950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-084c3b42-69bc-4745-811c-4238ce9f2513" returned: 0 in 1.109s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2520ee63-378d-4ee1-816a-fd79e9c14f0e tempest-VolumesCloneNegativeTest-1552286950 None] Lock "cinder-quobyte-084c3b42-69bc-4745-811c-4238ce9f2513" released by "delete_volume" :: held 2.450s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:37:02 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-2520ee63-378d-4ee1-816a-fd79e9c14f0e tempest-VolumesCloneNegativeTest-1552286950 None] Created reservations ['78deec54-e7e4-4c62-8bb4-450d6560e3fc', 'c98c555c-7a84-4d5e-a52e-f83247484e24', 'd9357ce3-cab8-49bf-84f6-4337a68b4aca', 'ab631103-06b8-4016-b85f-f61bf24844bb'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:37:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2520ee63-378d-4ee1-816a-fd79e9c14f0e tempest-VolumesCloneNegativeTest-1552286950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2520ee63-378d-4ee1-816a-fd79e9c14f0e tempest-VolumesCloneNegativeTest-1552286950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2520ee63-378d-4ee1-816a-fd79e9c14f0e tempest-VolumesCloneNegativeTest-1552286950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:37:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2520ee63-378d-4ee1-816a-fd79e9c14f0e tempest-VolumesCloneNegativeTest-1552286950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:37:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2520ee63-378d-4ee1-816a-fd79e9c14f0e tempest-VolumesCloneNegativeTest-1552286950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2520ee63-378d-4ee1-816a-fd79e9c14f0e tempest-VolumesCloneNegativeTest-1552286950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:02 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:37:02 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:03 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2520ee63-378d-4ee1-816a-fd79e9c14f0e tempest-VolumesCloneNegativeTest-1552286950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.795s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:03 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-2520ee63-378d-4ee1-816a-fd79e9c14f0e tempest-VolumesCloneNegativeTest-1552286950 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:37:03 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-2520ee63-378d-4ee1-816a-fd79e9c14f0e tempest-VolumesCloneNegativeTest-1552286950 None] Deleted volume successfully. Jul 10 00:37:03 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-aa25bf78-6dfb-4fe0-82c6-29fae2e08277 tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8f811c93-ab5c-4d73-8fba-bdd03a057daf" returned: 0 in 1.238s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:03 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-2520ee63-378d-4ee1-816a-fd79e9c14f0e tempest-VolumesCloneNegativeTest-1552286950 None] Lock "cinder-084c3b42-69bc-4745-811c-4238ce9f2513-delete_volume" released by "delete_volume" :: held 3.677s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:37:03 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-aa25bf78-6dfb-4fe0-82c6-29fae2e08277 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "cinder-quobyte-8f811c93-ab5c-4d73-8fba-bdd03a057daf" released by "delete_volume" :: held 2.429s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:37:03 devstack cinder-volume[88119]: WARNING cinder.quota [None req-aa25bf78-6dfb-4fe0-82c6-29fae2e08277 tempest-TestInstancesWithCinderVolumes-493128608 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-229620676-407949760 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-229620676-407949760, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:37:03 devstack cinder-volume[88119]: WARNING cinder.quota [None req-aa25bf78-6dfb-4fe0-82c6-29fae2e08277 tempest-TestInstancesWithCinderVolumes-493128608 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-229620676-407949760 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-229620676-407949760, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:37:03 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-aa25bf78-6dfb-4fe0-82c6-29fae2e08277 tempest-TestInstancesWithCinderVolumes-493128608 None] Created reservations ['c2edc149-2e49-4c9f-bbe4-e7cc2eb255fb', 'f0efded3-1110-4c74-aba7-49f8cd35f74c', '4533fa06-95e5-4882-8850-9d37dc23c62c', 'def1f846-d6a7-4d58-8b8a-902d6a28e49f'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:37:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-aa25bf78-6dfb-4fe0-82c6-29fae2e08277 tempest-TestInstancesWithCinderVolumes-493128608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-aa25bf78-6dfb-4fe0-82c6-29fae2e08277 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-aa25bf78-6dfb-4fe0-82c6-29fae2e08277 tempest-TestInstancesWithCinderVolumes-493128608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:37:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-aa25bf78-6dfb-4fe0-82c6-29fae2e08277 tempest-TestInstancesWithCinderVolumes-493128608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:37:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-aa25bf78-6dfb-4fe0-82c6-29fae2e08277 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-aa25bf78-6dfb-4fe0-82c6-29fae2e08277 tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:03 devstack sudo[101372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:37:03 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:04 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-aa25bf78-6dfb-4fe0-82c6-29fae2e08277 tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.177s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:04 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-aa25bf78-6dfb-4fe0-82c6-29fae2e08277 tempest-TestInstancesWithCinderVolumes-493128608 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:37:04 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-aa25bf78-6dfb-4fe0-82c6-29fae2e08277 tempest-TestInstancesWithCinderVolumes-493128608 None] Deleted volume successfully. Jul 10 00:37:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-aa25bf78-6dfb-4fe0-82c6-29fae2e08277 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "cinder-8f811c93-ab5c-4d73-8fba-bdd03a057daf-delete_volume" released by "delete_volume" :: held 4.029s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:37:07 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-7c7bc32d-46f6-43c1-a95f-fff9914e2668 req-7fa7a812-d3c9-4b78-9413-96f5e60233fd tempest-TestInstancesWithCinderVolumes-493128608 None] Terminate volume connection completed successfully. Jul 10 00:37:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-7c7bc32d-46f6-43c1-a95f-fff9914e2668 req-7fa7a812-d3c9-4b78-9413-96f5e60233fd tempest-TestInstancesWithCinderVolumes-493128608 None] Deleting attachment b1e06311-5543-422c-b842-619b3772a5cf. {{(pid=88119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 10 00:37:07 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:37:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Flow 'volume_create_manager' (34a52526-6245-4c93-878a-8edc46dfa026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:37:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf67043e-d52d-4e10-a735-3c78bf89fcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf67043e-d52d-4e10-a735-3c78bf89fcf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-471360031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d27cfede-1d46-4b2d-bde4-9bfe015743a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb8a78d188f1459ba8d11b232a83809f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:37:07Z,use_quota=True,user_id='e72a53ad53664128ba311c4ce7919bc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb81e83-89ed-4c4c-9676-65d8561e0dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb81e83-89ed-4c4c-9676-65d8561e0dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c828d80-9b5f-49fc-9009-248092b7992e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c828d80-9b5f-49fc-9009-248092b7992e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd27cfede-1d46-4b2d-bde4-9bfe015743a5', 'volume_name': 'volume-d27cfede-1d46-4b2d-bde4-9bfe015743a5', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced54f58-22df-4753-8fcd-551a6f85c6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced54f58-22df-4753-8fcd-551a6f85c6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae47304d-8667-4068-ad74-43830a279543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:07 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Volume d27cfede-1d46-4b2d-bde4-9bfe015743a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d27cfede-1d46-4b2d-bde4-9bfe015743a5', 'volume_size': 1} Jul 10 00:37:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-471360031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d27cfede-1d46-4b2d-bde4-9bfe015743a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb8a78d188f1459ba8d11b232a83809f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:37:07Z,use_quota=True,user_id='e72a53ad53664128ba311c4ce7919bc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:37:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Creating volume d27cfede-1d46-4b2d-bde4-9bfe015743a5 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:37:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:37:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:37:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:37:07 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:37:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d27cfede-1d46-4b2d-bde4-9bfe015743a5 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:07 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d27cfede-1d46-4b2d-bde4-9bfe015743a5 1073741824 Jul 10 00:37:07 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:08 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d27cfede-1d46-4b2d-bde4-9bfe015743a5 1073741824" returned: 0 in 0.918s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d27cfede-1d46-4b2d-bde4-9bfe015743a5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:08 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d27cfede-1d46-4b2d-bde4-9bfe015743a5 Jul 10 00:37:08 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:08 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d27cfede-1d46-4b2d-bde4-9bfe015743a5" returned: 0 in 0.640s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:37:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae47304d-8667-4068-ad74-43830a279543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d27cfede-1d46-4b2d-bde4-9bfe015743a5', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4049dfe4-7de1-491b-bf8c-641f41ebcc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:08 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Volume volume-d27cfede-1d46-4b2d-bde4-9bfe015743a5 (d27cfede-1d46-4b2d-bde4-9bfe015743a5): created successfully Jul 10 00:37:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4049dfe4-7de1-491b-bf8c-641f41ebcc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:09 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Flow 'volume_create_manager' (34a52526-6245-4c93-878a-8edc46dfa026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:37:09 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-6d6b8593-4fd0-4b20-8c13-e02bf2693497 tempest-VolumesNegativeTest-1217331385 None] Created volume successfully. Jul 10 00:37:09 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f5673bde-69a0-46ad-9a2d-6aec5694cce7 tempest-TestInstancesWithCinderVolumes-493128608 None] Acquiring lock "cinder-048053d2-90d8-477c-9621-f7f892b68f14-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:37:09 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f5673bde-69a0-46ad-9a2d-6aec5694cce7 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "cinder-048053d2-90d8-477c-9621-f7f892b68f14-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:37:09 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f5673bde-69a0-46ad-9a2d-6aec5694cce7 tempest-TestInstancesWithCinderVolumes-493128608 None] Acquiring lock "cinder-quobyte-048053d2-90d8-477c-9621-f7f892b68f14" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:37:09 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f5673bde-69a0-46ad-9a2d-6aec5694cce7 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "cinder-quobyte-048053d2-90d8-477c-9621-f7f892b68f14" acquired by "delete_volume" :: waited 0.025s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:37:09 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b06f57-008e-484e-8638-4520e88af015]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:37:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f5673bde-69a0-46ad-9a2d-6aec5694cce7 tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-048053d2-90d8-477c-9621-f7f892b68f14 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:09 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-048053d2-90d8-477c-9621-f7f892b68f14 Jul 10 00:37:09 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:10 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f5673bde-69a0-46ad-9a2d-6aec5694cce7 tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-048053d2-90d8-477c-9621-f7f892b68f14" returned: 0 in 1.008s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f5673bde-69a0-46ad-9a2d-6aec5694cce7 tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-048053d2-90d8-477c-9621-f7f892b68f14 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:10 devstack sudo[101415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-048053d2-90d8-477c-9621-f7f892b68f14 Jul 10 00:37:10 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:10 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f5673bde-69a0-46ad-9a2d-6aec5694cce7 tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-048053d2-90d8-477c-9621-f7f892b68f14" returned: 0 in 0.711s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:10 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f5673bde-69a0-46ad-9a2d-6aec5694cce7 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "cinder-quobyte-048053d2-90d8-477c-9621-f7f892b68f14" released by "delete_volume" :: held 1.792s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:37:10 devstack cinder-volume[88119]: WARNING cinder.quota [None req-f5673bde-69a0-46ad-9a2d-6aec5694cce7 tempest-TestInstancesWithCinderVolumes-493128608 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-766386948-1186718187 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-766386948-1186718187, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:37:10 devstack cinder-volume[88119]: WARNING cinder.quota [None req-f5673bde-69a0-46ad-9a2d-6aec5694cce7 tempest-TestInstancesWithCinderVolumes-493128608 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-766386948-1186718187 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-766386948-1186718187, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:37:11 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-f5673bde-69a0-46ad-9a2d-6aec5694cce7 tempest-TestInstancesWithCinderVolumes-493128608 None] Created reservations ['0161f4ff-3e89-47b6-822e-f3858cf7b27b', 'bb81ff10-b73e-47ff-94ce-dcfde47f3859', '2bcdda71-7c44-465a-bcf2-3f8a26c5aff7', '8aa203be-a2db-43c8-9082-527c9f7441a6'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:37:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f5673bde-69a0-46ad-9a2d-6aec5694cce7 tempest-TestInstancesWithCinderVolumes-493128608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f5673bde-69a0-46ad-9a2d-6aec5694cce7 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f5673bde-69a0-46ad-9a2d-6aec5694cce7 tempest-TestInstancesWithCinderVolumes-493128608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:37:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f5673bde-69a0-46ad-9a2d-6aec5694cce7 tempest-TestInstancesWithCinderVolumes-493128608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:37:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f5673bde-69a0-46ad-9a2d-6aec5694cce7 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f5673bde-69a0-46ad-9a2d-6aec5694cce7 tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:11 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:37:11 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:11 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f5673bde-69a0-46ad-9a2d-6aec5694cce7 tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.881s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:11 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-f5673bde-69a0-46ad-9a2d-6aec5694cce7 tempest-TestInstancesWithCinderVolumes-493128608 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:37:11 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-f5673bde-69a0-46ad-9a2d-6aec5694cce7 tempest-TestInstancesWithCinderVolumes-493128608 None] Deleted volume successfully. Jul 10 00:37:12 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f5673bde-69a0-46ad-9a2d-6aec5694cce7 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "cinder-048053d2-90d8-477c-9621-f7f892b68f14-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:37:21 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:UPDATE=76,cinder:SELECT=64,cinder:DELETE=5,cinder:INSERT=13 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:37:21 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-c080b6fe-6f59-4e0f-a6c4-6a14fc8ac311 req-f9d69ed5-0a03-4fb4-a840-2283079321ca tempest-TestInstancesWithCinderVolumes-493128608 None] Terminate volume connection completed successfully. Jul 10 00:37:21 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-c080b6fe-6f59-4e0f-a6c4-6a14fc8ac311 req-f9d69ed5-0a03-4fb4-a840-2283079321ca tempest-TestInstancesWithCinderVolumes-493128608 None] Deleting attachment 19f74348-d828-465a-88bb-f8d41eb01e46. {{(pid=88119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 10 00:37:25 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a585df73-c05e-4dbf-8c6d-d71541ae4d08 tempest-TestInstancesWithCinderVolumes-493128608 None] Acquiring lock "cinder-2d3fcfaa-0678-418a-a352-48050ddc33c0-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:37:25 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a585df73-c05e-4dbf-8c6d-d71541ae4d08 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "cinder-2d3fcfaa-0678-418a-a352-48050ddc33c0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:37:25 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a585df73-c05e-4dbf-8c6d-d71541ae4d08 tempest-TestInstancesWithCinderVolumes-493128608 None] Acquiring lock "cinder-quobyte-2d3fcfaa-0678-418a-a352-48050ddc33c0" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:37:25 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a585df73-c05e-4dbf-8c6d-d71541ae4d08 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "cinder-quobyte-2d3fcfaa-0678-418a-a352-48050ddc33c0" acquired by "delete_volume" :: waited 0.034s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:37:25 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42b6b1c-b9e1-43b6-a2bc-8bc562dde5ac]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:37:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a585df73-c05e-4dbf-8c6d-d71541ae4d08 tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:25 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0 Jul 10 00:37:25 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:26 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a585df73-c05e-4dbf-8c6d-d71541ae4d08 tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0" returned: 0 in 1.120s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a585df73-c05e-4dbf-8c6d-d71541ae4d08 tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:27 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0 Jul 10 00:37:27 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:27 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a585df73-c05e-4dbf-8c6d-d71541ae4d08 tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0" returned: 1 in 0.807s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a585df73-c05e-4dbf-8c6d-d71541ae4d08 tempest-TestInstancesWithCinderVolumes-493128608 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:37:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a585df73-c05e-4dbf-8c6d-d71541ae4d08 tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:27 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0 Jul 10 00:37:27 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:28 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a585df73-c05e-4dbf-8c6d-d71541ae4d08 tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2d3fcfaa-0678-418a-a352-48050ddc33c0" returned: 0 in 0.920s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:28 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a585df73-c05e-4dbf-8c6d-d71541ae4d08 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "cinder-quobyte-2d3fcfaa-0678-418a-a352-48050ddc33c0" released by "delete_volume" :: held 2.958s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:37:28 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=68,cinder:UPDATE=77,cinder:INSERT=20,cinder:DELETE=7 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:37:28 devstack cinder-volume[88119]: WARNING cinder.quota [None req-a585df73-c05e-4dbf-8c6d-d71541ae4d08 tempest-TestInstancesWithCinderVolumes-493128608 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-581333614-933104747 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-581333614-933104747, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:37:28 devstack cinder-volume[88119]: WARNING cinder.quota [None req-a585df73-c05e-4dbf-8c6d-d71541ae4d08 tempest-TestInstancesWithCinderVolumes-493128608 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-581333614-933104747 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-581333614-933104747, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:37:28 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-a585df73-c05e-4dbf-8c6d-d71541ae4d08 tempest-TestInstancesWithCinderVolumes-493128608 None] Created reservations ['406ba5e4-c31f-44cb-8183-9e133080a64f', '063a4302-f297-4197-b961-a5b76d092709', '4b8e4ebb-52f5-4c80-bf41-ddee0e223d88', 'fd7c133c-3e8c-489e-b76f-be0accdfcfa7'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:37:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a585df73-c05e-4dbf-8c6d-d71541ae4d08 tempest-TestInstancesWithCinderVolumes-493128608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a585df73-c05e-4dbf-8c6d-d71541ae4d08 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a585df73-c05e-4dbf-8c6d-d71541ae4d08 tempest-TestInstancesWithCinderVolumes-493128608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:37:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a585df73-c05e-4dbf-8c6d-d71541ae4d08 tempest-TestInstancesWithCinderVolumes-493128608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:37:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a585df73-c05e-4dbf-8c6d-d71541ae4d08 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a585df73-c05e-4dbf-8c6d-d71541ae4d08 tempest-TestInstancesWithCinderVolumes-493128608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:28 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:37:28 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:30 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a585df73-c05e-4dbf-8c6d-d71541ae4d08 tempest-TestInstancesWithCinderVolumes-493128608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.315s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:30 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-a585df73-c05e-4dbf-8c6d-d71541ae4d08 tempest-TestInstancesWithCinderVolumes-493128608 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:37:30 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-a585df73-c05e-4dbf-8c6d-d71541ae4d08 tempest-TestInstancesWithCinderVolumes-493128608 None] Deleted volume successfully. Jul 10 00:37:30 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a585df73-c05e-4dbf-8c6d-d71541ae4d08 tempest-TestInstancesWithCinderVolumes-493128608 None] Lock "cinder-2d3fcfaa-0678-418a-a352-48050ddc33c0-delete_volume" released by "delete_volume" :: held 4.632s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:37:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:37:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:37:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:37:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:31 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:37:31 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:32 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.107s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:32 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:37:32 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:37:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 29 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:37:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:37:33 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-d05a9ef9-ccc5-47ae-81b6-6d91efe36ce0 req-024bfffc-0122-43de-8033-42be8d0ef496 tempest-TestMinimumBasicScenario-98408840 None] Terminate volume connection completed successfully. Jul 10 00:37:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-d05a9ef9-ccc5-47ae-81b6-6d91efe36ce0 req-024bfffc-0122-43de-8033-42be8d0ef496 tempest-TestMinimumBasicScenario-98408840 None] Deleting attachment 3d2e0f19-156a-4743-ac74-128d902066be. {{(pid=88119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 10 00:37:36 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-33ffda02-cb48-4fc5-81ea-6b22209b9e9d tempest-TestMinimumBasicScenario-98408840 None] Acquiring lock "cinder-2c3b5468-7a64-4333-92e5-9ee3a76c88f7-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:37:36 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-33ffda02-cb48-4fc5-81ea-6b22209b9e9d tempest-TestMinimumBasicScenario-98408840 None] Lock "cinder-2c3b5468-7a64-4333-92e5-9ee3a76c88f7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:37:36 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-33ffda02-cb48-4fc5-81ea-6b22209b9e9d tempest-TestMinimumBasicScenario-98408840 None] Acquiring lock "cinder-quobyte-2c3b5468-7a64-4333-92e5-9ee3a76c88f7" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:37:36 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-33ffda02-cb48-4fc5-81ea-6b22209b9e9d tempest-TestMinimumBasicScenario-98408840 None] Lock "cinder-quobyte-2c3b5468-7a64-4333-92e5-9ee3a76c88f7" acquired by "delete_volume" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:37:36 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[99813abe-1e3b-4280-83f7-9ba1da952e8b]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:37:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-33ffda02-cb48-4fc5-81ea-6b22209b9e9d tempest-TestMinimumBasicScenario-98408840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2c3b5468-7a64-4333-92e5-9ee3a76c88f7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:36 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2c3b5468-7a64-4333-92e5-9ee3a76c88f7 Jul 10 00:37:36 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:37 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-33ffda02-cb48-4fc5-81ea-6b22209b9e9d tempest-TestMinimumBasicScenario-98408840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2c3b5468-7a64-4333-92e5-9ee3a76c88f7" returned: 0 in 1.056s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-33ffda02-cb48-4fc5-81ea-6b22209b9e9d tempest-TestMinimumBasicScenario-98408840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2c3b5468-7a64-4333-92e5-9ee3a76c88f7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:37 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2c3b5468-7a64-4333-92e5-9ee3a76c88f7 Jul 10 00:37:37 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:38 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-33ffda02-cb48-4fc5-81ea-6b22209b9e9d tempest-TestMinimumBasicScenario-98408840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2c3b5468-7a64-4333-92e5-9ee3a76c88f7" returned: 0 in 0.856s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:38 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-33ffda02-cb48-4fc5-81ea-6b22209b9e9d tempest-TestMinimumBasicScenario-98408840 None] Lock "cinder-quobyte-2c3b5468-7a64-4333-92e5-9ee3a76c88f7" released by "delete_volume" :: held 1.984s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:37:38 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-33ffda02-cb48-4fc5-81ea-6b22209b9e9d tempest-TestMinimumBasicScenario-98408840 None] Created reservations ['3737c5e9-0dfa-4538-992f-0b2200b474dd', '9f32ccf9-b7b9-45d6-a670-e2042f54e545', '6198cbeb-d911-44f6-8c25-a79c8c22a80f', '0d27d0cb-9aaf-4c5c-8b8f-2da098c12d4a'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:37:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-33ffda02-cb48-4fc5-81ea-6b22209b9e9d tempest-TestMinimumBasicScenario-98408840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-33ffda02-cb48-4fc5-81ea-6b22209b9e9d tempest-TestMinimumBasicScenario-98408840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:38 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-33ffda02-cb48-4fc5-81ea-6b22209b9e9d tempest-TestMinimumBasicScenario-98408840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:37:38 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-33ffda02-cb48-4fc5-81ea-6b22209b9e9d tempest-TestMinimumBasicScenario-98408840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:37:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-33ffda02-cb48-4fc5-81ea-6b22209b9e9d tempest-TestMinimumBasicScenario-98408840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-33ffda02-cb48-4fc5-81ea-6b22209b9e9d tempest-TestMinimumBasicScenario-98408840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:38 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:37:38 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:39 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-33ffda02-cb48-4fc5-81ea-6b22209b9e9d tempest-TestMinimumBasicScenario-98408840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.933s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:39 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-33ffda02-cb48-4fc5-81ea-6b22209b9e9d tempest-TestMinimumBasicScenario-98408840 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:37:39 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-33ffda02-cb48-4fc5-81ea-6b22209b9e9d tempest-TestMinimumBasicScenario-98408840 None] Deleted volume successfully. Jul 10 00:37:39 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-33ffda02-cb48-4fc5-81ea-6b22209b9e9d tempest-TestMinimumBasicScenario-98408840 None] Lock "cinder-2c3b5468-7a64-4333-92e5-9ee3a76c88f7-delete_volume" released by "delete_volume" :: held 3.266s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:37:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-226cd0ed-2a5b-4a53-9851-322e922fd396 tempest-VolumesNegativeTest-1217331385 None] Acquiring lock "cinder-d27cfede-1d46-4b2d-bde4-9bfe015743a5-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:37:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-226cd0ed-2a5b-4a53-9851-322e922fd396 tempest-VolumesNegativeTest-1217331385 None] Lock "cinder-d27cfede-1d46-4b2d-bde4-9bfe015743a5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:37:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-226cd0ed-2a5b-4a53-9851-322e922fd396 tempest-VolumesNegativeTest-1217331385 None] Acquiring lock "cinder-quobyte-d27cfede-1d46-4b2d-bde4-9bfe015743a5" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:37:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-226cd0ed-2a5b-4a53-9851-322e922fd396 tempest-VolumesNegativeTest-1217331385 None] Lock "cinder-quobyte-d27cfede-1d46-4b2d-bde4-9bfe015743a5" acquired by "delete_volume" :: waited 0.021s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:37:46 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f1b61d-8bc6-47e4-92fe-5350dda87ff0]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:37:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-226cd0ed-2a5b-4a53-9851-322e922fd396 tempest-VolumesNegativeTest-1217331385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d27cfede-1d46-4b2d-bde4-9bfe015743a5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:46 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d27cfede-1d46-4b2d-bde4-9bfe015743a5 Jul 10 00:37:46 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:47 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-226cd0ed-2a5b-4a53-9851-322e922fd396 tempest-VolumesNegativeTest-1217331385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d27cfede-1d46-4b2d-bde4-9bfe015743a5" returned: 0 in 1.404s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-226cd0ed-2a5b-4a53-9851-322e922fd396 tempest-VolumesNegativeTest-1217331385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d27cfede-1d46-4b2d-bde4-9bfe015743a5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:48 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d27cfede-1d46-4b2d-bde4-9bfe015743a5 Jul 10 00:37:48 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:49 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-226cd0ed-2a5b-4a53-9851-322e922fd396 tempest-VolumesNegativeTest-1217331385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d27cfede-1d46-4b2d-bde4-9bfe015743a5" returned: 0 in 1.154s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-226cd0ed-2a5b-4a53-9851-322e922fd396 tempest-VolumesNegativeTest-1217331385 None] Lock "cinder-quobyte-d27cfede-1d46-4b2d-bde4-9bfe015743a5" released by "delete_volume" :: held 2.644s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:37:49 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-226cd0ed-2a5b-4a53-9851-322e922fd396 tempest-VolumesNegativeTest-1217331385 None] Created reservations ['21751ccd-048a-40db-a310-6ea19784bff7', '6470520d-fb44-4968-a569-fa34c5854ceb', '457d4b0a-0106-4302-8f00-ff3d7e4f7506', '626b4bc5-260d-47bf-925f-632a14292ebd'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:37:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-226cd0ed-2a5b-4a53-9851-322e922fd396 tempest-VolumesNegativeTest-1217331385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-226cd0ed-2a5b-4a53-9851-322e922fd396 tempest-VolumesNegativeTest-1217331385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-226cd0ed-2a5b-4a53-9851-322e922fd396 tempest-VolumesNegativeTest-1217331385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:37:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-226cd0ed-2a5b-4a53-9851-322e922fd396 tempest-VolumesNegativeTest-1217331385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:37:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-226cd0ed-2a5b-4a53-9851-322e922fd396 tempest-VolumesNegativeTest-1217331385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-226cd0ed-2a5b-4a53-9851-322e922fd396 tempest-VolumesNegativeTest-1217331385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:49 devstack sudo[101777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:37:49 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:50 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-226cd0ed-2a5b-4a53-9851-322e922fd396 tempest-VolumesNegativeTest-1217331385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.029s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:50 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-226cd0ed-2a5b-4a53-9851-322e922fd396 tempest-VolumesNegativeTest-1217331385 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:37:50 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-226cd0ed-2a5b-4a53-9851-322e922fd396 tempest-VolumesNegativeTest-1217331385 None] Deleted volume successfully. Jul 10 00:37:50 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-226cd0ed-2a5b-4a53-9851-322e922fd396 tempest-VolumesNegativeTest-1217331385 None] Lock "cinder-d27cfede-1d46-4b2d-bde4-9bfe015743a5-delete_volume" released by "delete_volume" :: held 4.008s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:37:52 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:37:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Flow 'volume_create_manager' (2c720c6d-0f19-4787-968c-0934c4b47dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:37:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa92178a-807c-425b-8748-bb895a00b87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa92178a-807c-425b-8748-bb895a00b87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddf447ad-085e-4270-91eb-8952e3773985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d1c1aeae2b645f6a5a61c27faf26721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:37:53Z,use_quota=True,user_id='358e093cf2f94a648cb042484f32d6fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e68be092-fdfb-4b66-b93a-33d67d79cd0c),volume_type_id=e68be092-fdfb-4b66-b93a-33d67d79cd0c)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c4a843-9041-40f0-9ac6-6bc2ff4381b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8c4a843-9041-40f0-9ac6-6bc2ff4381b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b65dcc9-35db-4e67-be54-9d226addc967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:52 devstack cinder-volume[88119]: DEBUG cinder.image.glance [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Creating Keystone auth plugin from conf {{(pid=88119) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 00:37:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b65dcc9-35db-4e67-be54-9d226addc967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ddf447ad-085e-4270-91eb-8952e3773985', 'volume_name': 'volume-ddf447ad-085e-4270-91eb-8952e3773985', 'volume_size': 1, 'image_id': 'ece9e1a0-89af-4f82-a11f-fe692338b601', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ece9e1a0-89af-4f82-a11f-fe692338b601', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '04763fddf2f5b87e0411314549278da1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6d1c1aeae2b645f6a5a61c27faf26721', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ee2660b1928ae299523132f10d054e73833d69aa30b082246615738221390c3191849ca3380ebf4e688a76946f39851f0a64ab1c2f8c0c81239b54adf57e0769', 'id': 'ece9e1a0-89af-4f82-a11f-fe692338b601', 'created_at': datetime.datetime(2026, 7, 9, 22, 37, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 37, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ece9e1a0-89af-4f82-a11f-fe692338b601/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae716484-d7da-4df8-9a9b-34f8ba0ba475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae716484-d7da-4df8-9a9b-34f8ba0ba475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25ed4c4-70ae-4885-8db8-ffe42c2d49b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:53 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Volume ddf447ad-085e-4270-91eb-8952e3773985: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ddf447ad-085e-4270-91eb-8952e3773985', 'volume_size': 1, 'image_id': 'ece9e1a0-89af-4f82-a11f-fe692338b601', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ece9e1a0-89af-4f82-a11f-fe692338b601', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '04763fddf2f5b87e0411314549278da1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6d1c1aeae2b645f6a5a61c27faf26721', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ee2660b1928ae299523132f10d054e73833d69aa30b082246615738221390c3191849ca3380ebf4e688a76946f39851f0a64ab1c2f8c0c81239b54adf57e0769', 'id': 'ece9e1a0-89af-4f82-a11f-fe692338b601', 'created_at': datetime.datetime(2026, 7, 9, 22, 37, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 37, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ece9e1a0-89af-4f82-a11f-fe692338b601/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 10 00:37:53 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Trying to clone ddf447ad-085e-4270-91eb-8952e3773985 from image ece9e1a0-89af-4f82-a11f-fe692338b601 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ece9e1a0-89af-4f82-a11f-fe692338b601', 'metadata': {}}]). {{(pid=88119) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 00:37:53 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ece9e1a0-89af-4f82-a11f-fe692338b601_ay2b75wxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 00:37:53 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Image download 0.00 MB at 0.00 MB/s Jul 10 00:37:53 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bfbee8-70bf-4797-8b17-314a3e54cedd]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:37:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ece9e1a0-89af-4f82-a11f-fe692338b601_ay2b75wxdevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:54 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ece9e1a0-89af-4f82-a11f-fe692338b601_ay2b75wxdevstack@QuobyteHD Jul 10 00:37:54 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:54 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:37:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Flow 'volume_create_manager' (affe601d-d8f5-4d36-9340-ff35affbd4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:37:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c8b19c5-6d5c-4068-b1ce-8f7d8e6633f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c8b19c5-6d5c-4068-b1ce-8f7d8e6633f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1153201744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baaa14a4-e585-497b-b53a-861db984f02a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c76603c370a443881a06b15ba87a28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:37:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:37:54Z,use_quota=True,user_id='ac8429ac8f0042adb3b758b9addb0340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f645ebfa-2e94-4ac5-91f1-f142bc4499e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f645ebfa-2e94-4ac5-91f1-f142bc4499e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7de1ab-c1e6-4632-a246-7f97747486c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7de1ab-c1e6-4632-a246-7f97747486c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baaa14a4-e585-497b-b53a-861db984f02a', 'volume_name': 'volume-baaa14a4-e585-497b-b53a-861db984f02a', 'volume_size': 2}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f1c304-f97f-4c9a-8b7e-47657ede991e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f1c304-f97f-4c9a-8b7e-47657ede991e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ccad9c5-cfb8-40ae-8d6c-dc6d6886f80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:54 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Volume baaa14a4-e585-497b-b53a-861db984f02a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baaa14a4-e585-497b-b53a-861db984f02a', 'volume_size': 2} Jul 10 00:37:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1153201744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baaa14a4-e585-497b-b53a-861db984f02a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c76603c370a443881a06b15ba87a28b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:37:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:37:54Z,use_quota=True,user_id='ac8429ac8f0042adb3b758b9addb0340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:37:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Creating volume baaa14a4-e585-497b-b53a-861db984f02a {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:37:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:37:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:37:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:37:54 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:37:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a 2147483648 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:54 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a 2147483648 Jul 10 00:37:54 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:54 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ece9e1a0-89af-4f82-a11f-fe692338b601_ay2b75wxdevstack@QuobyteHD" returned: 0 in 1.081s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ece9e1a0-89af-4f82-a11f-fe692338b601_ay2b75wxdevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:55 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ece9e1a0-89af-4f82-a11f-fe692338b601_ay2b75wxdevstack@QuobyteHD Jul 10 00:37:55 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:55 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ece9e1a0-89af-4f82-a11f-fe692338b601_ay2b75wxdevstack@QuobyteHD" returned: 1 in 0.872s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ece9e1a0-89af-4f82-a11f-fe692338b601_ay2b75wxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:37:55 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Temporary image ece9e1a0-89af-4f82-a11f-fe692338b601 is fetched for user 358e093cf2f94a648cb042484f32d6fb. {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 00:37:55 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a 2147483648" returned: 0 in 1.238s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:55 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0e7cec-70b3-4b98-947c-0de457f14453]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:37:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ece9e1a0-89af-4f82-a11f-fe692338b601_ay2b75wxdevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:56 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a Jul 10 00:37:56 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:56 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ece9e1a0-89af-4f82-a11f-fe692338b601_ay2b75wxdevstack@QuobyteHD Jul 10 00:37:56 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:56 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a" returned: 0 in 1.034s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] <== create_volume: return (2362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:37:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.367s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:56 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:57 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ccad9c5-cfb8-40ae-8d6c-dc6d6886f80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baaa14a4-e585-497b-b53a-861db984f02a', 'volume_size': 2}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:57 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a25de3-61ab-4bbe-9ef4-01116e5b326c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:37:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ece9e1a0-89af-4f82-a11f-fe692338b601_ay2b75wxdevstack@QuobyteHD" returned: 0 in 1.146s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ece9e1a0-89af-4f82-a11f-fe692338b601_ay2b75wxdevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:57 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Volume volume-baaa14a4-e585-497b-b53a-861db984f02a (baaa14a4-e585-497b-b53a-861db984f02a): created successfully Jul 10 00:37:57 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a25de3-61ab-4bbe-9ef4-01116e5b326c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:37:57 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Flow 'volume_create_manager' (affe601d-d8f5-4d36-9340-ff35affbd4ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:37:57 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-f785e2b9-716d-4308-aecf-6969de9a3a4a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Created volume successfully. Jul 10 00:37:57 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ece9e1a0-89af-4f82-a11f-fe692338b601_ay2b75wxdevstack@QuobyteHD Jul 10 00:37:57 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:58 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ece9e1a0-89af-4f82-a11f-fe692338b601_ay2b75wxdevstack@QuobyteHD" returned: 1 in 1.069s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ece9e1a0-89af-4f82-a11f-fe692338b601_ay2b75wxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:37:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddf447ad-085e-4270-91eb-8952e3773985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d1c1aeae2b645f6a5a61c27faf26721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:37:53Z,use_quota=True,user_id='358e093cf2f94a648cb042484f32d6fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e68be092-fdfb-4b66-b93a-33d67d79cd0c),volume_type_id=e68be092-fdfb-4b66-b93a-33d67d79cd0c)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:37:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Creating volume ddf447ad-085e-4270-91eb-8952e3773985 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:37:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:37:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:37:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:37:58 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:37:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:58 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985 1073741824 Jul 10 00:37:58 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-81acf761-da2d-4c65-975f-cc6a605fa34a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:37:59 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985 1073741824" returned: 0 in 1.060s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:37:59 devstack sudo[101844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985 Jul 10 00:37:59 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:37:59 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root Jul 10 00:37:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985" returned: 0 in 0.747s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:37:59 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:37:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.873s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:37:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-81acf761-da2d-4c65-975f-cc6a605fa34a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.826s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:37:59 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-81acf761-da2d-4c65-975f-cc6a605fa34a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Creating offline snapshot f3608978-b256-4d38-9e33-7689d38f43c6 of volume baaa14a4-e585-497b-b53a-861db984f02a {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:38:00 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Attempting download of ece9e1a0-89af-4f82-a11f-fe692338b601 ((None, [{'url': 'file:///opt/stack/data/glance/images/ece9e1a0-89af-4f82-a11f-fe692338b601', 'metadata': {}}])) to volume ddf447ad-085e-4270-91eb-8952e3773985. {{(pid=88119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 00:38:00 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd49cc09-1474-4daa-9cf7-11123ca48a60]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-81acf761-da2d-4c65-975f-cc6a605fa34a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:00 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce61ab94-a776-475e-817a-792cae865207]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ece9e1a0-89af-4f82-a11f-fe692338b601_xg4yj4s1 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:00 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a Jul 10 00:38:00 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:00 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ece9e1a0-89af-4f82-a11f-fe692338b601_xg4yj4s1 Jul 10 00:38:00 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:00 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-81acf761-da2d-4c65-975f-cc6a605fa34a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a" returned: 0 in 0.819s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-81acf761-da2d-4c65-975f-cc6a605fa34a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a.f3608978-b256-4d38-9e33-7689d38f43c6 2G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:00 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a.f3608978-b256-4d38-9e33-7689d38f43c6 2G Jul 10 00:38:00 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:00 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ece9e1a0-89af-4f82-a11f-fe692338b601_xg4yj4s1" returned: 0 in 0.877s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ece9e1a0-89af-4f82-a11f-fe692338b601_xg4yj4s1 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:01 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ece9e1a0-89af-4f82-a11f-fe692338b601_xg4yj4s1 Jul 10 00:38:01 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:01 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:01 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-81acf761-da2d-4c65-975f-cc6a605fa34a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a.f3608978-b256-4d38-9e33-7689d38f43c6 2G" returned: 0 in 1.046s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-81acf761-da2d-4c65-975f-cc6a605fa34a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baaa14a4-e585-497b-b53a-861db984f02a -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a.f3608978-b256-4d38-9e33-7689d38f43c6 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ece9e1a0-89af-4f82-a11f-fe692338b601_xg4yj4s1" returned: 1 in 0.946s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ece9e1a0-89af-4f82-a11f-fe692338b601_xg4yj4s1' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:38:01 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3479f6d-ac73-4de8-b6d8-00e9dba2f0a2]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ece9e1a0-89af-4f82-a11f-fe692338b601_ay2b75wxdevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:01 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baaa14a4-e585-497b-b53a-861db984f02a -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a.f3608978-b256-4d38-9e33-7689d38f43c6 Jul 10 00:38:01 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:02 devstack sudo[101866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ece9e1a0-89af-4f82-a11f-fe692338b601_ay2b75wxdevstack@QuobyteHD Jul 10 00:38:02 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:02 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-81acf761-da2d-4c65-975f-cc6a605fa34a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-baaa14a4-e585-497b-b53a-861db984f02a -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a.f3608978-b256-4d38-9e33-7689d38f43c6" returned: 0 in 0.781s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:02 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-81acf761-da2d-4c65-975f-cc6a605fa34a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a.f3608978-b256-4d38-9e33-7689d38f43c6 is being set with open permissions: ugo+rw Jul 10 00:38:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-81acf761-da2d-4c65-975f-cc6a605fa34a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a.f3608978-b256-4d38-9e33-7689d38f43c6 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:02 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a.f3608978-b256-4d38-9e33-7689d38f43c6 Jul 10 00:38:02 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:02 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ece9e1a0-89af-4f82-a11f-fe692338b601_ay2b75wxdevstack@QuobyteHD" returned: 0 in 0.888s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ece9e1a0-89af-4f82-a11f-fe692338b601_ay2b75wxdevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:02 devstack sudo[101877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ece9e1a0-89af-4f82-a11f-fe692338b601_ay2b75wxdevstack@QuobyteHD Jul 10 00:38:02 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:03 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-81acf761-da2d-4c65-975f-cc6a605fa34a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a.f3608978-b256-4d38-9e33-7689d38f43c6" returned: 0 in 0.676s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-81acf761-da2d-4c65-975f-cc6a605fa34a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:03 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a.info Jul 10 00:38:03 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:03 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ece9e1a0-89af-4f82-a11f-fe692338b601_ay2b75wxdevstack@QuobyteHD" returned: 1 in 0.819s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ece9e1a0-89af-4f82-a11f-fe692338b601_ay2b75wxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:38:03 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] ece9e1a0-89af-4f82-a11f-fe692338b601 was raw, converting to raw {{(pid=88119) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 00:38:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ece9e1a0-89af-4f82-a11f-fe692338b601_ay2b75wxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:03 devstack sudo[101885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ece9e1a0-89af-4f82-a11f-fe692338b601_ay2b75wxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985 Jul 10 00:38:03 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:04 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-81acf761-da2d-4c65-975f-cc6a605fa34a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a.info" returned: 0 in 0.785s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:04 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-81acf761-da2d-4c65-975f-cc6a605fa34a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a.info is being set with open permissions: ugo+rw Jul 10 00:38:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-81acf761-da2d-4c65-975f-cc6a605fa34a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:04 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a.info Jul 10 00:38:04 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:04 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ece9e1a0-89af-4f82-a11f-fe692338b601_ay2b75wxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985" returned: 0 in 0.790s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:04 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ece9e1a0-89af-4f82-a11f-fe692338b601_ay2b75wxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985 {{(pid=88119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:38:04 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 00:38:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:04 devstack sudo[101893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985 1G Jul 10 00:38:04 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:04 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-81acf761-da2d-4c65-975f-cc6a605fa34a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a.info" returned: 0 in 0.744s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-81acf761-da2d-4c65-975f-cc6a605fa34a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.953s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:04 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-81acf761-da2d-4c65-975f-cc6a605fa34a tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Create snapshot completed successfully Jul 10 00:38:05 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985 1G" returned: 0 in 0.818s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:05 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8e064b-ecd9-48e8-8336-7f22579763fa]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:05 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985 Jul 10 00:38:05 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-00b19588-ad70-415d-95e1-1f295f07d0a5 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Acquiring lock "cinder-f3608978-b256-4d38-9e33-7689d38f43c6-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-00b19588-ad70-415d-95e1-1f295f07d0a5 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Lock "cinder-f3608978-b256-4d38-9e33-7689d38f43c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-00b19588-ad70-415d-95e1-1f295f07d0a5 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Acquiring lock "cinder-quobyte-baaa14a4-e585-497b-b53a-861db984f02a" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-00b19588-ad70-415d-95e1-1f295f07d0a5 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Lock "cinder-quobyte-baaa14a4-e585-497b-b53a-861db984f02a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-00b19588-ad70-415d-95e1-1f295f07d0a5 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Acquiring lock "cinder-quobyte-f3608978-b256-4d38-9e33-7689d38f43c6" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-00b19588-ad70-415d-95e1-1f295f07d0a5 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Lock "cinder-quobyte-f3608978-b256-4d38-9e33-7689d38f43c6" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-00b19588-ad70-415d-95e1-1f295f07d0a5 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Deleting offline snapshot f3608978-b256-4d38-9e33-7689d38f43c6 of volume baaa14a4-e585-497b-b53a-861db984f02a {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:38:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-00b19588-ad70-415d-95e1-1f295f07d0a5 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] snapshot_file for this snap is: volume-baaa14a4-e585-497b-b53a-861db984f02a.f3608978-b256-4d38-9e33-7689d38f43c6 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:38:05 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cdc5d5-9b60-47b5-85c7-c599c19a2954]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-00b19588-ad70-415d-95e1-1f295f07d0a5 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a.f3608978-b256-4d38-9e33-7689d38f43c6 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:05 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a.f3608978-b256-4d38-9e33-7689d38f43c6 Jul 10 00:38:05 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:06 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985" returned: 0 in 1.012s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:06 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985 Jul 10 00:38:06 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:06 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-00b19588-ad70-415d-95e1-1f295f07d0a5 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a.f3608978-b256-4d38-9e33-7689d38f43c6" returned: 0 in 1.021s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:06 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-00b19588-ad70-415d-95e1-1f295f07d0a5 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-baaa14a4-e585-497b-b53a-861db984f02a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:38:06 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c3d290-f8db-4241-855a-76d5fc8ed4b8]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-00b19588-ad70-415d-95e1-1f295f07d0a5 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:06 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a Jul 10 00:38:06 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:07 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985" returned: 1 in 1.075s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:38:07 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Downloaded image ece9e1a0-89af-4f82-a11f-fe692338b601 ((None, [{'url': 'file:///opt/stack/data/glance/images/ece9e1a0-89af-4f82-a11f-fe692338b601', 'metadata': {}}])) to volume ddf447ad-085e-4270-91eb-8952e3773985 successfully. {{(pid=88119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 00:38:07 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Temporary image ece9e1a0-89af-4f82-a11f-fe692338b601 for user 358e093cf2f94a648cb042484f32d6fb is deleted. {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 00:38:07 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Marking volume ddf447ad-085e-4270-91eb-8952e3773985 as bootable. {{(pid=88119) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 00:38:07 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Copying metadata from image ece9e1a0-89af-4f82-a11f-fe692338b601 to ddf447ad-085e-4270-91eb-8952e3773985. {{(pid=88119) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 00:38:07 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Creating volume glance metadata for volume ddf447ad-085e-4270-91eb-8952e3773985 backed by image ece9e1a0-89af-4f82-a11f-fe692338b601 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ece9e1a0-89af-4f82-a11f-fe692338b601', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '04763fddf2f5b87e0411314549278da1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88119) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 00:38:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25ed4c4-70ae-4885-8db8-ffe42c2d49b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddf447ad-085e-4270-91eb-8952e3773985', 'volume_size': 1, 'image_id': 'ece9e1a0-89af-4f82-a11f-fe692338b601', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ece9e1a0-89af-4f82-a11f-fe692338b601', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '04763fddf2f5b87e0411314549278da1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6d1c1aeae2b645f6a5a61c27faf26721', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ee2660b1928ae299523132f10d054e73833d69aa30b082246615738221390c3191849ca3380ebf4e688a76946f39851f0a64ab1c2f8c0c81239b54adf57e0769', 'id': 'ece9e1a0-89af-4f82-a11f-fe692338b601', 'created_at': datetime.datetime(2026, 7, 9, 22, 37, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 37, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ece9e1a0-89af-4f82-a11f-fe692338b601/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b772df58-4224-4d37-81f3-22316b981f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:07 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Volume volume-ddf447ad-085e-4270-91eb-8952e3773985 (ddf447ad-085e-4270-91eb-8952e3773985): created successfully Jul 10 00:38:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b772df58-4224-4d37-81f3-22316b981f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Flow 'volume_create_manager' (2c720c6d-0f19-4787-968c-0934c4b47dff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:07 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-88f68da0-2516-4f34-bca4-5243dc431004 tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Created volume successfully. Jul 10 00:38:07 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-00b19588-ad70-415d-95e1-1f295f07d0a5 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a" returned: 0 in 1.052s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-00b19588-ad70-415d-95e1-1f295f07d0a5 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a.f3608978-b256-4d38-9e33-7689d38f43c6 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:07 devstack sudo[101919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a.f3608978-b256-4d38-9e33-7689d38f43c6 Jul 10 00:38:07 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a6e1f9b9-e84b-48b6-8669-6097947236ac tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Acquiring lock "cinder-ddf447ad-085e-4270-91eb-8952e3773985-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a6e1f9b9-e84b-48b6-8669-6097947236ac tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Lock "cinder-ddf447ad-085e-4270-91eb-8952e3773985-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a6e1f9b9-e84b-48b6-8669-6097947236ac tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Acquiring lock "cinder-quobyte-ddf447ad-085e-4270-91eb-8952e3773985" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a6e1f9b9-e84b-48b6-8669-6097947236ac tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Lock "cinder-quobyte-ddf447ad-085e-4270-91eb-8952e3773985" acquired by "delete_volume" :: waited 0.024s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:08 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ce446e-0105-438f-8c01-02e91603085a]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a6e1f9b9-e84b-48b6-8669-6097947236ac tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:08 devstack sudo[101921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985 Jul 10 00:38:08 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:08 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-00b19588-ad70-415d-95e1-1f295f07d0a5 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a.f3608978-b256-4d38-9e33-7689d38f43c6" returned: 0 in 1.103s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-00b19588-ad70-415d-95e1-1f295f07d0a5 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a.f3608978-b256-4d38-9e33-7689d38f43c6 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:08 devstack sudo[101926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a.f3608978-b256-4d38-9e33-7689d38f43c6 Jul 10 00:38:08 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:09 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a6e1f9b9-e84b-48b6-8669-6097947236ac tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985" returned: 0 in 1.054s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a6e1f9b9-e84b-48b6-8669-6097947236ac tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:09 devstack sudo[101930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985 Jul 10 00:38:09 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:09 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-00b19588-ad70-415d-95e1-1f295f07d0a5 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a.f3608978-b256-4d38-9e33-7689d38f43c6" returned: 0 in 0.818s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:09 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-00b19588-ad70-415d-95e1-1f295f07d0a5 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Lock "cinder-quobyte-f3608978-b256-4d38-9e33-7689d38f43c6" released by "_delete_snapshot" :: held 4.133s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:09 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-00b19588-ad70-415d-95e1-1f295f07d0a5 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Lock "cinder-quobyte-baaa14a4-e585-497b-b53a-861db984f02a" released by "delete_snapshot" :: held 4.167s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:09 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-00b19588-ad70-415d-95e1-1f295f07d0a5 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Created reservations ['8964c4bb-9223-45ec-8fef-fb3ff48fe13f', 'db952b14-9016-4070-8d49-ce5269d5aba2', 'b490b722-7eb3-4b98-8b2d-3d662d01de86', '58428d8a-f8c2-4a4d-b262-9b3858845de0'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:38:09 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-00b19588-ad70-415d-95e1-1f295f07d0a5 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Delete snapshot completed successfully. Jul 10 00:38:09 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-00b19588-ad70-415d-95e1-1f295f07d0a5 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Lock "cinder-f3608978-b256-4d38-9e33-7689d38f43c6-delete_snapshot" released by "delete_snapshot" :: held 4.395s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:10 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a6e1f9b9-e84b-48b6-8669-6097947236ac tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985" returned: 1 in 0.899s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a6e1f9b9-e84b-48b6-8669-6097947236ac tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:38:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a6e1f9b9-e84b-48b6-8669-6097947236ac tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:10 devstack sudo[101938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985 Jul 10 00:38:10 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:10 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f32b13e7-4ec0-49dc-88df-b3fe59c7de63 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Acquiring lock "cinder-baaa14a4-e585-497b-b53a-861db984f02a-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:10 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f32b13e7-4ec0-49dc-88df-b3fe59c7de63 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Lock "cinder-baaa14a4-e585-497b-b53a-861db984f02a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f32b13e7-4ec0-49dc-88df-b3fe59c7de63 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Acquiring lock "cinder-quobyte-baaa14a4-e585-497b-b53a-861db984f02a" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f32b13e7-4ec0-49dc-88df-b3fe59c7de63 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Lock "cinder-quobyte-baaa14a4-e585-497b-b53a-861db984f02a" acquired by "delete_volume" :: waited 0.024s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9f8d25-c22e-401a-a53e-a6c5a4e0463f]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f32b13e7-4ec0-49dc-88df-b3fe59c7de63 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Flow 'volume_create_manager' (1990ed20-4377-409c-8f88-c7e86ddc1581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca6ea09-da4d-41f5-bd4b-e689fb982fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca6ea09-da4d-41f5-bd4b-e689fb982fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1959562260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53fba100-d9ed-479c-90eb-b55a15cad1fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb8554eb00694113aacffcd082e6084a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:11Z,use_quota=True,user_id='bf70f3782d13441c85c84a8fc8b58146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:11 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4f9f49b-3413-484d-baa1-f52eec778a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:11 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:11 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4f9f49b-3413-484d-baa1-f52eec778a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ed1e22-d639-481f-8bb2-0f62750df418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ed1e22-d639-481f-8bb2-0f62750df418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53fba100-d9ed-479c-90eb-b55a15cad1fb', 'volume_name': 'volume-53fba100-d9ed-479c-90eb-b55a15cad1fb', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e1e18b-074c-4519-85e6-93b6708d2b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e1e18b-074c-4519-85e6-93b6708d2b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (386859b2-69db-43fb-ac2f-fad79f10efe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:11 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Volume 53fba100-d9ed-479c-90eb-b55a15cad1fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53fba100-d9ed-479c-90eb-b55a15cad1fb', 'volume_size': 1} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1959562260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53fba100-d9ed-479c-90eb-b55a15cad1fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb8554eb00694113aacffcd082e6084a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:11Z,use_quota=True,user_id='bf70f3782d13441c85c84a8fc8b58146',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Creating volume 53fba100-d9ed-479c-90eb-b55a15cad1fb {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:38:11 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-53fba100-d9ed-479c-90eb-b55a15cad1fb 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a6e1f9b9-e84b-48b6-8669-6097947236ac tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-ddf447ad-085e-4270-91eb-8952e3773985" returned: 0 in 0.992s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:11 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-53fba100-d9ed-479c-90eb-b55a15cad1fb 1073741824 Jul 10 00:38:11 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a6e1f9b9-e84b-48b6-8669-6097947236ac tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Lock "cinder-quobyte-ddf447ad-085e-4270-91eb-8952e3773985" released by "delete_volume" :: held 3.076s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:11 devstack cinder-volume[88119]: WARNING cinder.quota [None req-a6e1f9b9-e84b-48b6-8669-6097947236ac tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:38:11 devstack cinder-volume[88119]: WARNING cinder.quota [None req-a6e1f9b9-e84b-48b6-8669-6097947236ac tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-a6e1f9b9-e84b-48b6-8669-6097947236ac tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Created reservations ['3720737e-a0ea-4a61-a65b-3a7cc2429ea0', '2e46c94c-68f6-41f8-b04c-bef441e4a12d', '4620faeb-a190-44e1-a13f-b760d246137b', '51054a6c-25cf-4b55-9c7b-693f645418be'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a6e1f9b9-e84b-48b6-8669-6097947236ac tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a6e1f9b9-e84b-48b6-8669-6097947236ac tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a6e1f9b9-e84b-48b6-8669-6097947236ac tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a6e1f9b9-e84b-48b6-8669-6097947236ac tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a6e1f9b9-e84b-48b6-8669-6097947236ac tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a6e1f9b9-e84b-48b6-8669-6097947236ac tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:11 devstack sudo[101945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:38:11 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:12 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f32b13e7-4ec0-49dc-88df-b3fe59c7de63 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a" returned: 0 in 1.367s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f32b13e7-4ec0-49dc-88df-b3fe59c7de63 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:12 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a Jul 10 00:38:12 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:12 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-53fba100-d9ed-479c-90eb-b55a15cad1fb 1073741824" returned: 0 in 1.406s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-53fba100-d9ed-479c-90eb-b55a15cad1fb {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:12 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a6e1f9b9-e84b-48b6-8669-6097947236ac tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.295s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:12 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-a6e1f9b9-e84b-48b6-8669-6097947236ac tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:38:12 devstack sudo[101957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-53fba100-d9ed-479c-90eb-b55a15cad1fb Jul 10 00:38:12 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:12 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-a6e1f9b9-e84b-48b6-8669-6097947236ac tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Deleted volume successfully. Jul 10 00:38:12 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a6e1f9b9-e84b-48b6-8669-6097947236ac tempest-VolumeAndVolumeTypeFromImageTest-36913709 None] Lock "cinder-ddf447ad-085e-4270-91eb-8952e3773985-delete_volume" released by "delete_volume" :: held 4.702s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:13 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:13 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-53fba100-d9ed-479c-90eb-b55a15cad1fb" returned: 0 in 0.929s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] <== create_volume: return (2414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:38:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.417s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f32b13e7-4ec0-49dc-88df-b3fe59c7de63 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-baaa14a4-e585-497b-b53a-861db984f02a" returned: 0 in 1.241s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (386859b2-69db-43fb-ac2f-fad79f10efe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53fba100-d9ed-479c-90eb-b55a15cad1fb', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006ae2f7-958e-4dde-b0d3-45206290f363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:13 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f32b13e7-4ec0-49dc-88df-b3fe59c7de63 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Lock "cinder-quobyte-baaa14a4-e585-497b-b53a-861db984f02a" released by "delete_volume" :: held 2.709s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:13 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Volume volume-53fba100-d9ed-479c-90eb-b55a15cad1fb (53fba100-d9ed-479c-90eb-b55a15cad1fb): created successfully Jul 10 00:38:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (006ae2f7-958e-4dde-b0d3-45206290f363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Flow 'volume_create_manager' (1990ed20-4377-409c-8f88-c7e86ddc1581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:13 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-42c602cb-cc7e-4e74-81b4-3d9b2ce927ce tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Created volume successfully. Jul 10 00:38:13 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-f32b13e7-4ec0-49dc-88df-b3fe59c7de63 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Created reservations ['a032d30c-56d3-4bc7-af0f-6a60239f09a6', '816bc4de-9cfa-46a6-982f-ef3fccb34f8e', '7eeadbd9-feb0-4b1a-936e-564d094ece07', '75b41dfb-f708-4a99-8349-c8c1c0e3a685'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:38:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f32b13e7-4ec0-49dc-88df-b3fe59c7de63 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f32b13e7-4ec0-49dc-88df-b3fe59c7de63 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f32b13e7-4ec0-49dc-88df-b3fe59c7de63 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f32b13e7-4ec0-49dc-88df-b3fe59c7de63 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f32b13e7-4ec0-49dc-88df-b3fe59c7de63 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f32b13e7-4ec0-49dc-88df-b3fe59c7de63 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:14 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:38:14 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:14 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f32b13e7-4ec0-49dc-88df-b3fe59c7de63 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.001s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:14 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-f32b13e7-4ec0-49dc-88df-b3fe59c7de63 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:38:14 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-f32b13e7-4ec0-49dc-88df-b3fe59c7de63 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Deleted volume successfully. Jul 10 00:38:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f32b13e7-4ec0-49dc-88df-b3fe59c7de63 tempest-VolumesSnapshotNegativeTestJSON-154727416 None] Lock "cinder-baaa14a4-e585-497b-b53a-861db984f02a-delete_volume" released by "delete_volume" :: held 4.039s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-8ac85227-55c8-4203-ae19-09f5ed877a03 req-54f24e41-eae9-4e4b-888b-c0890dc2091b tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-8ac85227-55c8-4203-ae19-09f5ed877a03 req-54f24e41-eae9-4e4b-888b-c0890dc2091b tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:17 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e6e79a-8cb8-4047-aff0-dd5bd8e6af9a]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-8ac85227-55c8-4203-ae19-09f5ed877a03 req-54f24e41-eae9-4e4b-888b-c0890dc2091b tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-53fba100-d9ed-479c-90eb-b55a15cad1fb {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:18 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-53fba100-d9ed-479c-90eb-b55a15cad1fb Jul 10 00:38:18 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:18 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-8ac85227-55c8-4203-ae19-09f5ed877a03 req-54f24e41-eae9-4e4b-888b-c0890dc2091b tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-53fba100-d9ed-479c-90eb-b55a15cad1fb" returned: 0 in 1.010s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-8ac85227-55c8-4203-ae19-09f5ed877a03 req-54f24e41-eae9-4e4b-888b-c0890dc2091b tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.035s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:18 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:38:18 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Flow 'volume_create_manager' (cc089382-1ac3-454f-8787-8f2bdc414955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:18 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdfd53d-a825-4ab9-aeb9-da787084e11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdfd53d-a825-4ab9-aeb9-da787084e11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1724311057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='132be039629542f2a53726423b601af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:19Z,use_quota=True,user_id='80723e597c8e4829983f2acf6e3a4ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd64202-53ab-43d9-968d-d69995d99538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dd64202-53ab-43d9-968d-d69995d99538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95cba6d8-3820-4ee2-98f6-3431a001b1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95cba6d8-3820-4ee2-98f6-3431a001b1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689', 'volume_name': 'volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd9e4845-a127-481f-a321-6c50866a4847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd9e4845-a127-481f-a321-6c50866a4847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb7eb37-ebae-46ea-95b0-e5a933a462f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:19 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Volume 8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689', 'volume_size': 1} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1724311057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='132be039629542f2a53726423b601af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:19Z,use_quota=True,user_id='80723e597c8e4829983f2acf6e3a4ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Creating volume 8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:38:19 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-8ac85227-55c8-4203-ae19-09f5ed877a03 req-54f24e41-eae9-4e4b-888b-c0890dc2091b tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff', 'name': 'volume-53fba100-d9ed-479c-90eb-b55a15cad1fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9545fe5-733b-492a-959d-f5681ee2513a', 'enforce_multipath': True} {{(pid=88119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 10 00:38:19 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 1073741824 Jul 10 00:38:19 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:19 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-8ac85227-55c8-4203-ae19-09f5ed877a03 req-54f24e41-eae9-4e4b-888b-c0890dc2091b tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] attachment_update completed successfully. Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Flow 'volume_create_manager' (cee7b6c8-a621-47dc-a83e-e9bd37fdbae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0347d7f6-b2bd-4410-8aaf-9031b27eeb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0347d7f6-b2bd-4410-8aaf-9031b27eeb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1190262046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47434c4899b4f9aba7430aa578fde0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:20Z,use_quota=True,user_id='8bc9184bd9c445268d6514a06f9fe31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2de1805-8f6a-401a-9066-a007b7d500d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2de1805-8f6a-401a-9066-a007b7d500d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c57741d-c3ae-494d-8475-b1cfbf97792d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c57741d-c3ae-494d-8475-b1cfbf97792d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba', 'volume_name': 'volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3747f606-03bf-48ca-b6d7-d8e83f146c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3747f606-03bf-48ca-b6d7-d8e83f146c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fc2b2cd-5a33-424f-a6a6-5048fc0ca2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:19 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Volume dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba', 'volume_size': 1} Jul 10 00:38:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:20 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 1073741824" returned: 0 in 1.196s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:20 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 Jul 10 00:38:20 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:21 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689" returned: 0 in 0.768s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:21 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] <== create_volume: return (2006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:38:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.274s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:21 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1190262046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47434c4899b4f9aba7430aa578fde0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:20Z,use_quota=True,user_id='8bc9184bd9c445268d6514a06f9fe31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:38:21 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Creating volume dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:38:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:21 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:21 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:21 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:38:21 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:38:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:21 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb7eb37-ebae-46ea-95b0-e5a933a462f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:21 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d9de92d-0efb-4581-b20b-afce73d87bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:21 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba 1073741824 Jul 10 00:38:21 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:21 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Volume volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 (8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689): created successfully Jul 10 00:38:21 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d9de92d-0efb-4581-b20b-afce73d87bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:21 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Flow 'volume_create_manager' (cc089382-1ac3-454f-8787-8f2bdc414955) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:21 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=60,cinder:UPDATE=69,cinder:INSERT=24,cinder:DELETE=4 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:38:21 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-0bd653e5-12c2-4cdc-9153-a3c5c570bbc2 tempest-VolumeDependencyTests-857054667 None] Created volume successfully. Jul 10 00:38:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-440be0ca-ce6f-42ed-ac59-f9775599df48 tempest-VolumeDependencyTests-857054667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:22 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba 1073741824" returned: 0 in 1.071s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:22 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba Jul 10 00:38:22 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:22 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba" returned: 0 in 0.747s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:22 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:38:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-440be0ca-ce6f-42ed-ac59-f9775599df48 tempest-VolumeDependencyTests-857054667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.029s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:23 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fc2b2cd-5a33-424f-a6a6-5048fc0ca2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:23 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba388db-a460-4061-b2fe-0ac7990c5994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:23 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-440be0ca-ce6f-42ed-ac59-f9775599df48 tempest-VolumeDependencyTests-857054667 None] Creating offline snapshot a67ce41c-a7af-46cc-939d-c0fdda850c3c of volume 8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:38:23 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Volume volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba (dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba): created successfully Jul 10 00:38:23 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba388db-a460-4061-b2fe-0ac7990c5994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:23 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Flow 'volume_create_manager' (cee7b6c8-a621-47dc-a83e-e9bd37fdbae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:23 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fef787d-b09f-4616-81b7-a43ab92a7551]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-440be0ca-ce6f-42ed-ac59-f9775599df48 tempest-VolumeDependencyTests-857054667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:23 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-d8ae7716-b3c9-485e-a225-69d8143ec5b9 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Created volume successfully. Jul 10 00:38:23 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 Jul 10 00:38:23 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:24 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-440be0ca-ce6f-42ed-ac59-f9775599df48 tempest-VolumeDependencyTests-857054667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689" returned: 0 in 0.981s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-440be0ca-ce6f-42ed-ac59-f9775599df48 tempest-VolumeDependencyTests-857054667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.a67ce41c-a7af-46cc-939d-c0fdda850c3c 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:24 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.a67ce41c-a7af-46cc-939d-c0fdda850c3c 1G Jul 10 00:38:24 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c871ea3f-7ea8-4ef9-af5e-ab90a903700a tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:24 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-440be0ca-ce6f-42ed-ac59-f9775599df48 tempest-VolumeDependencyTests-857054667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.a67ce41c-a7af-46cc-939d-c0fdda850c3c 1G" returned: 0 in 0.916s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-440be0ca-ce6f-42ed-ac59-f9775599df48 tempest-VolumeDependencyTests-857054667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.a67ce41c-a7af-46cc-939d-c0fdda850c3c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:25 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.a67ce41c-a7af-46cc-939d-c0fdda850c3c Jul 10 00:38:25 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:25 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-440be0ca-ce6f-42ed-ac59-f9775599df48 tempest-VolumeDependencyTests-857054667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.a67ce41c-a7af-46cc-939d-c0fdda850c3c" returned: 0 in 0.841s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:25 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-440be0ca-ce6f-42ed-ac59-f9775599df48 tempest-VolumeDependencyTests-857054667 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.a67ce41c-a7af-46cc-939d-c0fdda850c3c is being set with open permissions: ugo+rw Jul 10 00:38:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-440be0ca-ce6f-42ed-ac59-f9775599df48 tempest-VolumeDependencyTests-857054667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.a67ce41c-a7af-46cc-939d-c0fdda850c3c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:25 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.a67ce41c-a7af-46cc-939d-c0fdda850c3c Jul 10 00:38:25 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:26 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-440be0ca-ce6f-42ed-ac59-f9775599df48 tempest-VolumeDependencyTests-857054667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.a67ce41c-a7af-46cc-939d-c0fdda850c3c" returned: 0 in 0.667s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-440be0ca-ce6f-42ed-ac59-f9775599df48 tempest-VolumeDependencyTests-857054667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:26 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.info Jul 10 00:38:26 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:27 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-915271fd-2239-41d4-ae97-fe3e11bcdf5f req-c69a5a7d-b8f8-4afc-bac1-8acf9339a01e tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Terminate volume connection completed successfully. Jul 10 00:38:27 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-915271fd-2239-41d4-ae97-fe3e11bcdf5f req-c69a5a7d-b8f8-4afc-bac1-8acf9339a01e tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Deleting attachment b9545fe5-733b-492a-959d-f5681ee2513a. {{(pid=88119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 10 00:38:27 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-440be0ca-ce6f-42ed-ac59-f9775599df48 tempest-VolumeDependencyTests-857054667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.info" returned: 0 in 0.710s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:27 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-440be0ca-ce6f-42ed-ac59-f9775599df48 tempest-VolumeDependencyTests-857054667 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.info is being set with open permissions: ugo+rw Jul 10 00:38:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-440be0ca-ce6f-42ed-ac59-f9775599df48 tempest-VolumeDependencyTests-857054667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:27 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.info Jul 10 00:38:27 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:27 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-440be0ca-ce6f-42ed-ac59-f9775599df48 tempest-VolumeDependencyTests-857054667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.info" returned: 0 in 0.694s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-440be0ca-ce6f-42ed-ac59-f9775599df48 tempest-VolumeDependencyTests-857054667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.957s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c871ea3f-7ea8-4ef9-af5e-ab90a903700a tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.777s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:27 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-c871ea3f-7ea8-4ef9-af5e-ab90a903700a tempest-CreateVolumesFromSnapshotTest-1320363851 None] Creating offline snapshot e458c943-d41f-4123-bb96-d8442447eb81 of volume dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:38:28 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:38:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Flow 'volume_create_manager' (2c3f2759-995e-48da-a548-cc7fa3c730e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f25385f-5d43-4ca6-aafb-20d90c55ed09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:28 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1fa3ff-da8e-4e72-9f5f-dbc808013de4]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c871ea3f-7ea8-4ef9-af5e-ab90a903700a tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:28 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-440be0ca-ce6f-42ed-ac59-f9775599df48 tempest-VolumeDependencyTests-857054667 None] Create snapshot completed successfully Jul 10 00:38:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f25385f-5d43-4ca6-aafb-20d90c55ed09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-309598588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=657edcae-ccaf-45a5-ac24-596a64f46bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce306a4c59d47bf892ac8ab985ffaac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:28Z,use_quota=True,user_id='ea8e61b9317a435e9328b8354977cb27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f65fb52-009f-408a-ace4-41e47a2e3af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f65fb52-009f-408a-ace4-41e47a2e3af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc11320-bb2b-430c-a445-56b2f02981f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:28 devstack cinder-volume[88119]: DEBUG cinder.image.glance [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Creating Keystone auth plugin from conf {{(pid=88119) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 00:38:28 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba Jul 10 00:38:28 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc11320-bb2b-430c-a445-56b2f02981f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '657edcae-ccaf-45a5-ac24-596a64f46bee', 'volume_name': 'volume-657edcae-ccaf-45a5-ac24-596a64f46bee', 'volume_size': 1, 'image_id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a6d0c978-002e-4d46-ab92-a0880bff49c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9bf3eaae61a647cbbfcb8c7cdd60fe87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'created_at': datetime.datetime(2026, 7, 9, 22, 17, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 17, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a6d0c978-002e-4d46-ab92-a0880bff49c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c2241ef-937e-48cf-8649-234a50faafd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c2241ef-937e-48cf-8649-234a50faafd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (880f838d-bea7-4d7f-ad1c-ff795a6ec03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:28 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Volume 657edcae-ccaf-45a5-ac24-596a64f46bee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-657edcae-ccaf-45a5-ac24-596a64f46bee', 'volume_size': 1, 'image_id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a6d0c978-002e-4d46-ab92-a0880bff49c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9bf3eaae61a647cbbfcb8c7cdd60fe87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'created_at': datetime.datetime(2026, 7, 9, 22, 17, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 17, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a6d0c978-002e-4d46-ab92-a0880bff49c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 00:38:28 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Trying to clone 657edcae-ccaf-45a5-ac24-596a64f46bee from image a6d0c978-002e-4d46-ab92-a0880bff49c1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a6d0c978-002e-4d46-ab92-a0880bff49c1', 'metadata': {}}]). {{(pid=88119) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 00:38:28 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_4cm45y0adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 00:38:28 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Image download 20.69 MB at 20.69 MB/s Jul 10 00:38:28 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc12061-ad92-4469-ab78-d30f7d45e2a2]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_4cm45y0adevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:28 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c871ea3f-7ea8-4ef9-af5e-ab90a903700a tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba" returned: 0 in 0.923s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c871ea3f-7ea8-4ef9-af5e-ab90a903700a tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.e458c943-d41f-4123-bb96-d8442447eb81 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:28 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:INSERT=16,cinder:UPDATE=65,cinder:SELECT=57,cinder:DELETE=7 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:38:29 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:38:29 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.e458c943-d41f-4123-bb96-d8442447eb81 1G Jul 10 00:38:29 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Flow 'volume_create_manager' (f339659b-8c5d-4fa3-9379-19e08db2d2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e46faab2-72a9-4130-a733-590f1daef7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:29 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_4cm45y0adevstack@QuobyteHD Jul 10 00:38:29 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e46faab2-72a9-4130-a733-590f1daef7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1006708873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='132be039629542f2a53726423b601af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a67ce41c-a7af-46cc-939d-c0fdda850c3c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:29Z,use_quota=True,user_id='80723e597c8e4829983f2acf6e3a4ba9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb43825b-9a9a-4d83-9d17-1deb492270a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb43825b-9a9a-4d83-9d17-1deb492270a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (159cdf83-4a74-4aa3-8b23-85f2f511c2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (159cdf83-4a74-4aa3-8b23-85f2f511c2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea', 'volume_name': 'volume-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea', 'volume_size': 1, 'snapshot_id': 'a67ce41c-a7af-46cc-939d-c0fdda850c3c'}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b422c664-ec71-475f-91d6-214b2bb8c9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b422c664-ec71-475f-91d6-214b2bb8c9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd45e771-073f-4a67-9267-046a1385fd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:29 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Volume 7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea', 'volume_size': 1, 'snapshot_id': 'a67ce41c-a7af-46cc-939d-c0fdda850c3c'} Jul 10 00:38:29 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-9d72f683-7240-4687-90a9-6d672dff0d01 tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Acquiring lock "cinder-53fba100-d9ed-479c-90eb-b55a15cad1fb-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:29 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-9d72f683-7240-4687-90a9-6d672dff0d01 tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Lock "cinder-53fba100-d9ed-479c-90eb-b55a15cad1fb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:29 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-9d72f683-7240-4687-90a9-6d672dff0d01 tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Acquiring lock "cinder-quobyte-53fba100-d9ed-479c-90eb-b55a15cad1fb" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:29 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-9d72f683-7240-4687-90a9-6d672dff0d01 tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Lock "cinder-quobyte-53fba100-d9ed-479c-90eb-b55a15cad1fb" acquired by "delete_volume" :: waited 0.022s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:29 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c7112b-7e6c-4bd0-9e51-e5c1e8717e40]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9d72f683-7240-4687-90a9-6d672dff0d01 tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-53fba100-d9ed-479c-90eb-b55a15cad1fb {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:29 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-53fba100-d9ed-479c-90eb-b55a15cad1fb Jul 10 00:38:29 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:29 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_4cm45y0adevstack@QuobyteHD" returned: 0 in 0.799s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:29 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Temporary image a6d0c978-002e-4d46-ab92-a0880bff49c1 is fetched for user ea8e61b9317a435e9328b8354977cb27. {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 00:38:29 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c871ea3f-7ea8-4ef9-af5e-ab90a903700a tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.e458c943-d41f-4123-bb96-d8442447eb81 1G" returned: 0 in 0.854s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c871ea3f-7ea8-4ef9-af5e-ab90a903700a tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.e458c943-d41f-4123-bb96-d8442447eb81 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:29 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[61320ae4-3898-4840-977a-4d47ff3b0fbf]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_4cm45y0adevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:29 devstack sudo[102463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.e458c943-d41f-4123-bb96-d8442447eb81 Jul 10 00:38:29 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:29 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_4cm45y0adevstack@QuobyteHD Jul 10 00:38:29 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:30 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9d72f683-7240-4687-90a9-6d672dff0d01 tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-53fba100-d9ed-479c-90eb-b55a15cad1fb" returned: 0 in 0.799s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9d72f683-7240-4687-90a9-6d672dff0d01 tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-53fba100-d9ed-479c-90eb-b55a15cad1fb {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:30 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-53fba100-d9ed-479c-90eb-b55a15cad1fb Jul 10 00:38:30 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:30 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c871ea3f-7ea8-4ef9-af5e-ab90a903700a tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.e458c943-d41f-4123-bb96-d8442447eb81" returned: 0 in 0.736s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:30 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-c871ea3f-7ea8-4ef9-af5e-ab90a903700a tempest-CreateVolumesFromSnapshotTest-1320363851 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.e458c943-d41f-4123-bb96-d8442447eb81 is being set with open permissions: ugo+rw Jul 10 00:38:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c871ea3f-7ea8-4ef9-af5e-ab90a903700a tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.e458c943-d41f-4123-bb96-d8442447eb81 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:30 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_4cm45y0adevstack@QuobyteHD" returned: 0 in 0.736s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:30 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.e458c943-d41f-4123-bb96-d8442447eb81 Jul 10 00:38:30 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:30 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9d72f683-7240-4687-90a9-6d672dff0d01 tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-53fba100-d9ed-479c-90eb-b55a15cad1fb" returned: 0 in 0.665s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:30 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-9d72f683-7240-4687-90a9-6d672dff0d01 tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Lock "cinder-quobyte-53fba100-d9ed-479c-90eb-b55a15cad1fb" released by "delete_volume" :: held 1.500s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:30 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-9d72f683-7240-4687-90a9-6d672dff0d01 tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Created reservations ['15e1a6c4-6783-4e51-bf28-2aaa090dd3ab', 'ea557ce4-d5ac-4939-a768-72e4078bac3b', 'efe1a327-a928-40b5-9b76-6586aec74396', 'f24a7e9a-2085-4d4b-849a-1d92132e7656'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:38:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9d72f683-7240-4687-90a9-6d672dff0d01 tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9d72f683-7240-4687-90a9-6d672dff0d01 tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:30 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-9d72f683-7240-4687-90a9-6d672dff0d01 tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:30 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-9d72f683-7240-4687-90a9-6d672dff0d01 tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9d72f683-7240-4687-90a9-6d672dff0d01 tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9d72f683-7240-4687-90a9-6d672dff0d01 tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:30 devstack sudo[102482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:38:30 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:31 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c871ea3f-7ea8-4ef9-af5e-ab90a903700a tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.e458c943-d41f-4123-bb96-d8442447eb81" returned: 0 in 0.644s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c871ea3f-7ea8-4ef9-af5e-ab90a903700a tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:31 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.info Jul 10 00:38:31 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:31 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9d72f683-7240-4687-90a9-6d672dff0d01 tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.686s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:31 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-9d72f683-7240-4687-90a9-6d672dff0d01 tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:38:31 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-9d72f683-7240-4687-90a9-6d672dff0d01 tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Deleted volume successfully. Jul 10 00:38:31 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-9d72f683-7240-4687-90a9-6d672dff0d01 tempest-TestServerVolumeAttachScenarioOldVersion-1042426664 None] Lock "cinder-53fba100-d9ed-479c-90eb-b55a15cad1fb-delete_volume" released by "delete_volume" :: held 2.399s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:38:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:31 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:38:31 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:31 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c871ea3f-7ea8-4ef9-af5e-ab90a903700a tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.info" returned: 0 in 0.647s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:31 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-c871ea3f-7ea8-4ef9-af5e-ab90a903700a tempest-CreateVolumesFromSnapshotTest-1320363851 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.info is being set with open permissions: ugo+rw Jul 10 00:38:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c871ea3f-7ea8-4ef9-af5e-ab90a903700a tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:31 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.info Jul 10 00:38:31 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:32 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.641s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 29 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:38:32 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c871ea3f-7ea8-4ef9-af5e-ab90a903700a tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.info" returned: 0 in 0.678s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c871ea3f-7ea8-4ef9-af5e-ab90a903700a tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.622s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.422s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Acquiring lock "cinder-quobyte-a67ce41c-a7af-46cc-939d-c0fdda850c3c-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea" by "_create_volume_from_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Lock "cinder-quobyte-a67ce41c-a7af-46cc-939d-c0fdda850c3c-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Creating volume 7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea from snapshot a67ce41c-a7af-46cc-939d-c0fdda850c3c {{(pid=88119) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Acquiring lock "cinder-quobyte-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea" by "_copy_volume_from_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:32 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-c871ea3f-7ea8-4ef9-af5e-ab90a903700a tempest-CreateVolumesFromSnapshotTest-1320363851 None] Create snapshot completed successfully Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Lock "cinder-quobyte-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] snapshot: a67ce41c-a7af-46cc-939d-c0fdda850c3c, volume: 7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea, {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[330df7d6-7df3-4e7e-b05c-8c9c43edc392]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.a67ce41c-a7af-46cc-939d-c0fdda850c3c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:32 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.a67ce41c-a7af-46cc-939d-c0fdda850c3c Jul 10 00:38:32 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:33 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:38:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Flow 'volume_create_manager' (fced94d2-f0ac-4d28-8fe3-1a06f69bebae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c644e3f0-aef9-4cae-97cc-45bad35b647a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:33 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c644e3f0-aef9-4cae-97cc-45bad35b647a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1113156946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47434c4899b4f9aba7430aa578fde0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:33Z,use_quota=True,user_id='8bc9184bd9c445268d6514a06f9fe31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e94298d-722d-4d30-a8f4-56a65051fe6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e94298d-722d-4d30-a8f4-56a65051fe6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c09374-44f3-4a3c-a05c-cca34312e28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c09374-44f3-4a3c-a05c-cca34312e28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5', 'volume_name': 'volume-f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d678ee-fdbd-41f2-afa7-5c98191db93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d678ee-fdbd-41f2-afa7-5c98191db93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a22f5a87-6c9f-4bfa-bf8a-8385efea8de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:33 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Volume f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5', 'volume_size': 1} Jul 10 00:38:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.a67ce41c-a7af-46cc-939d-c0fdda850c3c" returned: 0 in 0.991s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:38:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 00:38:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Creating direct copy from snapshot {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 00:38:33 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c19da11-1cbc-45f2-b097-27c9222c5191]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:33 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 Jul 10 00:38:33 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:33 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Flow 'volume_create_manager' (65f10149-a08e-4eee-9d54-1bebae98493d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffeb09c4-b953-4bae-bc42-fea1d4deca50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffeb09c4-b953-4bae-bc42-fea1d4deca50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-251429015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf0b6f96-35da-4793-834f-0c64599bed79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47434c4899b4f9aba7430aa578fde0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:34Z,use_quota=True,user_id='8bc9184bd9c445268d6514a06f9fe31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9652d60d-8554-4b3c-83b0-89ddca195601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9652d60d-8554-4b3c-83b0-89ddca195601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727db454-662e-44cf-838a-daf86ad8565e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727db454-662e-44cf-838a-daf86ad8565e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf0b6f96-35da-4793-834f-0c64599bed79', 'volume_name': 'volume-cf0b6f96-35da-4793-834f-0c64599bed79', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (246ffe81-224f-4f67-a30d-b20be2ae50ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (246ffe81-224f-4f67-a30d-b20be2ae50ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee328637-8e37-44cf-9a74-a710e6c6f190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:34 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Volume cf0b6f96-35da-4793-834f-0c64599bed79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf0b6f96-35da-4793-834f-0c64599bed79', 'volume_size': 1} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Flow 'volume_create_manager' (a21abc48-0f4e-4f5e-aac2-1237f2de930b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6028806-622d-46d7-9050-39eb071e6900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6028806-622d-46d7-9050-39eb071e6900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2089281310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1ea4ea-66b8-4dd3-b25a-eba672532724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47434c4899b4f9aba7430aa578fde0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:34Z,use_quota=True,user_id='8bc9184bd9c445268d6514a06f9fe31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f176bf-ba01-48fc-b527-38d1e5c51814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f176bf-ba01-48fc-b527-38d1e5c51814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7d832f-85af-4595-a387-a500eb8808fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7d832f-85af-4595-a387-a500eb8808fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb1ea4ea-66b8-4dd3-b25a-eba672532724', 'volume_name': 'volume-bb1ea4ea-66b8-4dd3-b25a-eba672532724', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd99734f-5846-4d89-b525-31df1be88079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd99734f-5846-4d89-b525-31df1be88079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b723650-f60e-48ef-9e0c-a7312b954029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:34 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Volume bb1ea4ea-66b8-4dd3-b25a-eba672532724: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb1ea4ea-66b8-4dd3-b25a-eba672532724', 'volume_size': 1} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:34 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689" returned: 0 in 1.076s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.utils [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Path /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea not found in is_blk_device check {{(pid=88119) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:34 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea Jul 10 00:38:34 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Flow 'volume_create_manager' (b57a6a00-cb02-413e-97b3-743d82add7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96cabe4a-1162-4dbd-bd1c-c22644adb894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96cabe4a-1162-4dbd-bd1c-c22644adb894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1705852283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5202a7b4-8592-4537-a666-6f043e4235a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47434c4899b4f9aba7430aa578fde0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:35Z,use_quota=True,user_id='8bc9184bd9c445268d6514a06f9fe31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3929678-cdb3-45fd-ae34-02fb98225244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3929678-cdb3-45fd-ae34-02fb98225244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b37627-14d8-4192-ab33-f4d4ded15ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b37627-14d8-4192-ab33-f4d4ded15ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5202a7b4-8592-4537-a666-6f043e4235a0', 'volume_name': 'volume-5202a7b4-8592-4537-a666-6f043e4235a0', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3af9bb-c685-4694-a4bc-d9062d889cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3af9bb-c685-4694-a4bc-d9062d889cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e2dcb64-2b24-430a-873e-0bcbcd983440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:35 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Volume 5202a7b4-8592-4537-a666-6f043e4235a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5202a7b4-8592-4537-a666-6f043e4235a0', 'volume_size': 1} Jul 10 00:38:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:35 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:38:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Flow 'volume_create_manager' (f1d201da-547a-428d-aaf5-a7d5f44ca01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae460613-9f5d-4bf7-941a-b3c8bf00f452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae460613-9f5d-4bf7-941a-b3c8bf00f452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1345693513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7195f8a9-e978-4849-9944-e84615242d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47434c4899b4f9aba7430aa578fde0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:35Z,use_quota=True,user_id='8bc9184bd9c445268d6514a06f9fe31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ec8f3d-f0c7-40d7-a97d-64f234485c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5ec8f3d-f0c7-40d7-a97d-64f234485c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb0974a-6dae-4845-94fc-3787b1664412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb0974a-6dae-4845-94fc-3787b1664412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7195f8a9-e978-4849-9944-e84615242d85', 'volume_name': 'volume-7195f8a9-e978-4849-9944-e84615242d85', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fefb5ab-7adf-488d-8c32-77bdf8d45d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fefb5ab-7adf-488d-8c32-77bdf8d45d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35df5ae3-fe9b-4a89-bbbd-1767a0f50bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:35 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Volume 7195f8a9-e978-4849-9944-e84615242d85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7195f8a9-e978-4849-9944-e84615242d85', 'volume_size': 1} Jul 10 00:38:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:39 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea" returned: 0 in 5.071s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:39 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cd8118-4d71-445c-ad8c-9311bcd50f78]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:39 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 Jul 10 00:38:39 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:40 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689" returned: 0 in 0.960s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:40 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Image conversion details: src /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689, size 1024.00 MB, duration 5.07 sec, destination /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea {{(pid=88119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:38:40 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Converted 1024.00 MB image at 201.89 MB/s Jul 10 00:38:40 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea is being set with open permissions: ugo+rw Jul 10 00:38:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:40 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea Jul 10 00:38:40 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:41 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea" returned: 0 in 0.732s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:41 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Lock "cinder-quobyte-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea" released by "_copy_volume_from_snapshot" :: held 8.940s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:41 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Lock "cinder-quobyte-a67ce41c-a7af-46cc-939d-c0fdda850c3c-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea" released by "_create_volume_from_snapshot" :: held 8.971s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.991s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.994s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:41 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-309598588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=657edcae-ccaf-45a5-ac24-596a64f46bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce306a4c59d47bf892ac8ab985ffaac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:28Z,use_quota=True,user_id='ea8e61b9317a435e9328b8354977cb27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:38:41 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Creating volume 657edcae-ccaf-45a5-ac24-596a64f46bee {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:38:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:41 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:41 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:41 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:38:41 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:38:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:41 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee 1073741824 Jul 10 00:38:41 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:41 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd45e771-073f-4a67-9267-046a1385fd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea', 'volume_size': 1, 'snapshot_id': 'a67ce41c-a7af-46cc-939d-c0fdda850c3c'}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:41 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab90dcf4-fd99-4f66-ad16-e8a3aa854c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:41 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Volume volume-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea (7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea): created successfully Jul 10 00:38:41 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab90dcf4-fd99-4f66-ad16-e8a3aa854c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:41 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Flow 'volume_create_manager' (f339659b-8c5d-4fa3-9379-19e08db2d2b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:41 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-a13a877b-3bb4-4046-93ee-588e38a7fb54 tempest-VolumeDependencyTests-857054667 None] Created volume successfully. Jul 10 00:38:42 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8aa36b3e-48e4-493f-abd0-172ee6491559 tempest-VolumeDependencyTests-857054667 None] Acquiring lock "cinder-a67ce41c-a7af-46cc-939d-c0fdda850c3c-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:42 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8aa36b3e-48e4-493f-abd0-172ee6491559 tempest-VolumeDependencyTests-857054667 None] Lock "cinder-a67ce41c-a7af-46cc-939d-c0fdda850c3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:42 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8aa36b3e-48e4-493f-abd0-172ee6491559 tempest-VolumeDependencyTests-857054667 None] Acquiring lock "cinder-quobyte-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:42 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8aa36b3e-48e4-493f-abd0-172ee6491559 tempest-VolumeDependencyTests-857054667 None] Lock "cinder-quobyte-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:42 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8aa36b3e-48e4-493f-abd0-172ee6491559 tempest-VolumeDependencyTests-857054667 None] Acquiring lock "cinder-quobyte-a67ce41c-a7af-46cc-939d-c0fdda850c3c" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:42 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8aa36b3e-48e4-493f-abd0-172ee6491559 tempest-VolumeDependencyTests-857054667 None] Lock "cinder-quobyte-a67ce41c-a7af-46cc-939d-c0fdda850c3c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:42 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8aa36b3e-48e4-493f-abd0-172ee6491559 tempest-VolumeDependencyTests-857054667 None] Deleting offline snapshot a67ce41c-a7af-46cc-939d-c0fdda850c3c of volume 8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:38:42 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8aa36b3e-48e4-493f-abd0-172ee6491559 tempest-VolumeDependencyTests-857054667 None] snapshot_file for this snap is: volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.a67ce41c-a7af-46cc-939d-c0fdda850c3c {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:38:42 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db8c190-95d5-4801-8996-dcb44f301a65]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8aa36b3e-48e4-493f-abd0-172ee6491559 tempest-VolumeDependencyTests-857054667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.a67ce41c-a7af-46cc-939d-c0fdda850c3c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:42 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.a67ce41c-a7af-46cc-939d-c0fdda850c3c Jul 10 00:38:42 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:42 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee 1073741824" returned: 0 in 0.947s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:42 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee Jul 10 00:38:42 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:43 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8aa36b3e-48e4-493f-abd0-172ee6491559 tempest-VolumeDependencyTests-857054667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.a67ce41c-a7af-46cc-939d-c0fdda850c3c" returned: 0 in 0.858s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8aa36b3e-48e4-493f-abd0-172ee6491559 tempest-VolumeDependencyTests-857054667 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:38:43 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca42e8df-4df6-459b-9d2a-9cb0372ccd2d]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8aa36b3e-48e4-493f-abd0-172ee6491559 tempest-VolumeDependencyTests-857054667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:43 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee" returned: 0 in 0.709s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:38:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.624s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1113156946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47434c4899b4f9aba7430aa578fde0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:33Z,use_quota=True,user_id='8bc9184bd9c445268d6514a06f9fe31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:38:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Creating volume f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:38:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:38:43 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:38:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:43 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5 1073741824 Jul 10 00:38:43 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:43 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Attempting download of a6d0c978-002e-4d46-ab92-a0880bff49c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/a6d0c978-002e-4d46-ab92-a0880bff49c1', 'metadata': {}}])) to volume 657edcae-ccaf-45a5-ac24-596a64f46bee. {{(pid=88119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 00:38:43 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 Jul 10 00:38:43 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:43 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7cedfa-9fee-4a2f-a840-92864f7c92d4]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_j2cl66yl {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:43 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_j2cl66yl Jul 10 00:38:43 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:44 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8aa36b3e-48e4-493f-abd0-172ee6491559 tempest-VolumeDependencyTests-857054667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689" returned: 0 in 0.989s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8aa36b3e-48e4-493f-abd0-172ee6491559 tempest-VolumeDependencyTests-857054667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.a67ce41c-a7af-46cc-939d-c0fdda850c3c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:44 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.a67ce41c-a7af-46cc-939d-c0fdda850c3c Jul 10 00:38:44 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:44 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_j2cl66yl" returned: 0 in 0.907s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_j2cl66yl {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:44 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5 1073741824" returned: 0 in 1.130s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:44 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_j2cl66yl Jul 10 00:38:44 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:44 devstack sudo[102627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5 Jul 10 00:38:44 devstack sudo[102627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:45 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_j2cl66yl" returned: 1 in 0.868s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a6d0c978-002e-4d46-ab92-a0880bff49c1_j2cl66yl' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:38:45 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb74e7b8-3e1f-45de-9950-62f8ff40c411]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_4cm45y0adevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:45 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8aa36b3e-48e4-493f-abd0-172ee6491559 tempest-VolumeDependencyTests-857054667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.a67ce41c-a7af-46cc-939d-c0fdda850c3c" returned: 0 in 0.984s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8aa36b3e-48e4-493f-abd0-172ee6491559 tempest-VolumeDependencyTests-857054667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.a67ce41c-a7af-46cc-939d-c0fdda850c3c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:45 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.a67ce41c-a7af-46cc-939d-c0fdda850c3c Jul 10 00:38:45 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:45 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_4cm45y0adevstack@QuobyteHD Jul 10 00:38:45 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:45 devstack sudo[102627]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5" returned: 0 in 0.845s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] <== create_volume: return (2038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:38:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.267s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-251429015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf0b6f96-35da-4793-834f-0c64599bed79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47434c4899b4f9aba7430aa578fde0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:34Z,use_quota=True,user_id='8bc9184bd9c445268d6514a06f9fe31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:38:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Creating volume cf0b6f96-35da-4793-834f-0c64599bed79 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:38:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:38:45 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:38:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cf0b6f96-35da-4793-834f-0c64599bed79 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a22f5a87-6c9f-4bfa-bf8a-8385efea8de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b96a0dcc-3e9f-426f-8691-5670188d47b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:45 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cf0b6f96-35da-4793-834f-0c64599bed79 1073741824 Jul 10 00:38:45 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:45 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Volume volume-f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5 (f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5): created successfully Jul 10 00:38:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b96a0dcc-3e9f-426f-8691-5670188d47b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Flow 'volume_create_manager' (fced94d2-f0ac-4d28-8fe3-1a06f69bebae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:45 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-e0097f40-30d6-4a85-830b-2bf9c53dc7c5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Created volume successfully. Jul 10 00:38:46 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8aa36b3e-48e4-493f-abd0-172ee6491559 tempest-VolumeDependencyTests-857054667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689.a67ce41c-a7af-46cc-939d-c0fdda850c3c" returned: 0 in 0.807s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8aa36b3e-48e4-493f-abd0-172ee6491559 tempest-VolumeDependencyTests-857054667 None] Lock "cinder-quobyte-a67ce41c-a7af-46cc-939d-c0fdda850c3c" released by "_delete_snapshot" :: held 3.769s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:46 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_4cm45y0adevstack@QuobyteHD" returned: 0 in 0.885s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:46 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] a6d0c978-002e-4d46-ab92-a0880bff49c1 was qcow2, converting to raw {{(pid=88119) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 00:38:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_4cm45y0adevstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8aa36b3e-48e4-493f-abd0-172ee6491559 tempest-VolumeDependencyTests-857054667 None] Lock "cinder-quobyte-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689" released by "delete_snapshot" :: held 3.812s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:46 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_4cm45y0adevstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee Jul 10 00:38:46 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:46 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-8aa36b3e-48e4-493f-abd0-172ee6491559 tempest-VolumeDependencyTests-857054667 None] Created reservations ['6bedd807-5f2c-484b-9fd1-30d6f10b47a2', '416a084b-d5c3-406b-a50e-5d3df8dee479', 'fa149ab4-bf90-4c27-9fdc-0719e552a545', '9447f723-c668-4c70-abd6-9a3ba98d4e84'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:38:46 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-8aa36b3e-48e4-493f-abd0-172ee6491559 tempest-VolumeDependencyTests-857054667 None] Delete snapshot completed successfully. Jul 10 00:38:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8aa36b3e-48e4-493f-abd0-172ee6491559 tempest-VolumeDependencyTests-857054667 None] Lock "cinder-a67ce41c-a7af-46cc-939d-c0fdda850c3c-delete_snapshot" released by "delete_snapshot" :: held 4.010s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:46 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cf0b6f96-35da-4793-834f-0c64599bed79 1073741824" returned: 0 in 1.010s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cf0b6f96-35da-4793-834f-0c64599bed79 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:46 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cf0b6f96-35da-4793-834f-0c64599bed79 Jul 10 00:38:46 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ac98df75-ded0-451e-ab05-35278590be65 tempest-VolumeDependencyTests-857054667 None] Acquiring lock "cinder-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ac98df75-ded0-451e-ab05-35278590be65 tempest-VolumeDependencyTests-857054667 None] Lock "cinder-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ac98df75-ded0-451e-ab05-35278590be65 tempest-VolumeDependencyTests-857054667 None] Acquiring lock "cinder-quobyte-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ac98df75-ded0-451e-ab05-35278590be65 tempest-VolumeDependencyTests-857054667 None] Lock "cinder-quobyte-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689" acquired by "delete_volume" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:46 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32f5d4b-fcb8-4ae3-9159-25f794ed2c36]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ac98df75-ded0-451e-ab05-35278590be65 tempest-VolumeDependencyTests-857054667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:47 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 Jul 10 00:38:47 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:47 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cf0b6f96-35da-4793-834f-0c64599bed79" returned: 0 in 0.731s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:38:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.512s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2089281310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1ea4ea-66b8-4dd3-b25a-eba672532724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47434c4899b4f9aba7430aa578fde0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:34Z,use_quota=True,user_id='8bc9184bd9c445268d6514a06f9fe31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:38:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Creating volume bb1ea4ea-66b8-4dd3-b25a-eba672532724 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:38:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:38:47 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:38:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bb1ea4ea-66b8-4dd3-b25a-eba672532724 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:47 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bb1ea4ea-66b8-4dd3-b25a-eba672532724 1073741824 Jul 10 00:38:47 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee328637-8e37-44cf-9a74-a710e6c6f190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf0b6f96-35da-4793-834f-0c64599bed79', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f74504-9f09-477d-8251-6dafa077d35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:47 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Volume volume-cf0b6f96-35da-4793-834f-0c64599bed79 (cf0b6f96-35da-4793-834f-0c64599bed79): created successfully Jul 10 00:38:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f74504-9f09-477d-8251-6dafa077d35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Flow 'volume_create_manager' (65f10149-a08e-4eee-9d54-1bebae98493d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:47 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-1faf9f3d-8938-4f9c-a713-2e7510d8395d tempest-CreateVolumesFromSnapshotTest-1320363851 None] Created volume successfully. Jul 10 00:38:47 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ac98df75-ded0-451e-ab05-35278590be65 tempest-VolumeDependencyTests-857054667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689" returned: 0 in 1.058s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ac98df75-ded0-451e-ab05-35278590be65 tempest-VolumeDependencyTests-857054667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:47 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689 Jul 10 00:38:47 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:48 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bb1ea4ea-66b8-4dd3-b25a-eba672532724 1073741824" returned: 0 in 1.101s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bb1ea4ea-66b8-4dd3-b25a-eba672532724 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:48 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bb1ea4ea-66b8-4dd3-b25a-eba672532724 Jul 10 00:38:48 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:48 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_4cm45y0adevstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee" returned: 0 in 2.369s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:48 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a6d0c978-002e-4d46-ab92-a0880bff49c1_4cm45y0adevstack@QuobyteHD, size 112.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee {{(pid=88119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:38:48 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Converted 112.00 MB image at 47.19 MB/s Jul 10 00:38:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:48 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee 1G Jul 10 00:38:48 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:48 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ac98df75-ded0-451e-ab05-35278590be65 tempest-VolumeDependencyTests-857054667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689" returned: 0 in 0.958s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:48 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ac98df75-ded0-451e-ab05-35278590be65 tempest-VolumeDependencyTests-857054667 None] Lock "cinder-quobyte-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689" released by "delete_volume" :: held 2.104s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-ac98df75-ded0-451e-ab05-35278590be65 tempest-VolumeDependencyTests-857054667 None] Created reservations ['c3b32c51-6f6b-46d4-9652-63f71b7c5b06', '90a3483a-b372-41c1-9894-6a6693ed1acf', '12fa2422-82a1-44da-b952-bdd692d60f8e', 'ad9d1cae-93df-4c94-abe4-486d4a11591d'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:38:49 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ac98df75-ded0-451e-ab05-35278590be65 tempest-VolumeDependencyTests-857054667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ac98df75-ded0-451e-ab05-35278590be65 tempest-VolumeDependencyTests-857054667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ac98df75-ded0-451e-ab05-35278590be65 tempest-VolumeDependencyTests-857054667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ac98df75-ded0-451e-ab05-35278590be65 tempest-VolumeDependencyTests-857054667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ac98df75-ded0-451e-ab05-35278590be65 tempest-VolumeDependencyTests-857054667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ac98df75-ded0-451e-ab05-35278590be65 tempest-VolumeDependencyTests-857054667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bb1ea4ea-66b8-4dd3-b25a-eba672532724" returned: 0 in 0.815s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] <== create_volume: return (1984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.989s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.158s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1705852283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5202a7b4-8592-4537-a666-6f043e4235a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47434c4899b4f9aba7430aa578fde0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:35Z,use_quota=True,user_id='8bc9184bd9c445268d6514a06f9fe31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Creating volume 5202a7b4-8592-4537-a666-6f043e4235a0 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:49 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:38:49 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:38:49 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5202a7b4-8592-4537-a666-6f043e4235a0 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:49 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5202a7b4-8592-4537-a666-6f043e4235a0 1073741824 Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b723650-f60e-48ef-9e0c-a7312b954029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb1ea4ea-66b8-4dd3-b25a-eba672532724', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:49 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e36b7e-d6fc-4b9d-b51c-71083fbb5cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:49 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Volume volume-bb1ea4ea-66b8-4dd3-b25a-eba672532724 (bb1ea4ea-66b8-4dd3-b25a-eba672532724): created successfully Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e36b7e-d6fc-4b9d-b51c-71083fbb5cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Flow 'volume_create_manager' (a21abc48-0f4e-4f5e-aac2-1237f2de930b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:49 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-8a868980-4647-497f-a314-1f56cf094780 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Created volume successfully. Jul 10 00:38:49 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee 1G" returned: 0 in 0.891s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9822621-0db3-474f-91ee-7e046e18db1a]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:49 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee Jul 10 00:38:49 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:49 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ac98df75-ded0-451e-ab05-35278590be65 tempest-VolumeDependencyTests-857054667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.793s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:49 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-ac98df75-ded0-451e-ab05-35278590be65 tempest-VolumeDependencyTests-857054667 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:38:49 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-ac98df75-ded0-451e-ab05-35278590be65 tempest-VolumeDependencyTests-857054667 None] Deleted volume successfully. Jul 10 00:38:50 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ac98df75-ded0-451e-ab05-35278590be65 tempest-VolumeDependencyTests-857054667 None] Lock "cinder-8e9641df-aa4c-4fc6-93bc-d4c5ad3cd689-delete_volume" released by "delete_volume" :: held 3.261s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:50 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-608796f8-c33c-42de-ab8a-2514d17df991 tempest-VolumeDependencyTests-857054667 None] Acquiring lock "cinder-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:50 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-608796f8-c33c-42de-ab8a-2514d17df991 tempest-VolumeDependencyTests-857054667 None] Lock "cinder-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:50 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-608796f8-c33c-42de-ab8a-2514d17df991 tempest-VolumeDependencyTests-857054667 None] Acquiring lock "cinder-quobyte-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:50 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5202a7b4-8592-4537-a666-6f043e4235a0 1073741824" returned: 0 in 1.136s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:50 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-608796f8-c33c-42de-ab8a-2514d17df991 tempest-VolumeDependencyTests-857054667 None] Lock "cinder-quobyte-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea" acquired by "delete_volume" :: waited 0.034s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:50 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb1d2ed-c3b9-437c-9e8b-ab977b33b6e1]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608796f8-c33c-42de-ab8a-2514d17df991 tempest-VolumeDependencyTests-857054667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:50 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee" returned: 0 in 0.963s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5202a7b4-8592-4537-a666-6f043e4235a0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:50 devstack sudo[102709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5202a7b4-8592-4537-a666-6f043e4235a0 Jul 10 00:38:50 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:50 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea Jul 10 00:38:50 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:50 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee Jul 10 00:38:50 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:51 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5202a7b4-8592-4537-a666-6f043e4235a0" returned: 0 in 0.771s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.648s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1345693513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7195f8a9-e978-4849-9944-e84615242d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c47434c4899b4f9aba7430aa578fde0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:38:35Z,use_quota=True,user_id='8bc9184bd9c445268d6514a06f9fe31c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Creating volume 7195f8a9-e978-4849-9944-e84615242d85 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:38:51 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7195f8a9-e978-4849-9944-e84615242d85 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:51 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7195f8a9-e978-4849-9944-e84615242d85 1073741824 Jul 10 00:38:51 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e2dcb64-2b24-430a-873e-0bcbcd983440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5202a7b4-8592-4537-a666-6f043e4235a0', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:51 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be08c6ec-020d-443c-a130-ac5eae18ee9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608796f8-c33c-42de-ab8a-2514d17df991 tempest-VolumeDependencyTests-857054667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea" returned: 0 in 0.939s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608796f8-c33c-42de-ab8a-2514d17df991 tempest-VolumeDependencyTests-857054667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:51 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Volume volume-5202a7b4-8592-4537-a666-6f043e4235a0 (5202a7b4-8592-4537-a666-6f043e4235a0): created successfully Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be08c6ec-020d-443c-a130-ac5eae18ee9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Flow 'volume_create_manager' (b57a6a00-cb02-413e-97b3-743d82add7be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:51 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea Jul 10 00:38:51 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:51 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-40ce31c9-1814-440f-ae88-b8e8ef2b06d1 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Created volume successfully. Jul 10 00:38:51 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee" returned: 1 in 1.056s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Downloaded image a6d0c978-002e-4d46-ab92-a0880bff49c1 ((None, [{'url': 'file:///opt/stack/data/glance/images/a6d0c978-002e-4d46-ab92-a0880bff49c1', 'metadata': {}}])) to volume 657edcae-ccaf-45a5-ac24-596a64f46bee successfully. {{(pid=88119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Temporary image a6d0c978-002e-4d46-ab92-a0880bff49c1 for user ea8e61b9317a435e9328b8354977cb27 is deleted. {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Marking volume 657edcae-ccaf-45a5-ac24-596a64f46bee as bootable. {{(pid=88119) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Copying metadata from image a6d0c978-002e-4d46-ab92-a0880bff49c1 to 657edcae-ccaf-45a5-ac24-596a64f46bee. {{(pid=88119) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Creating volume glance metadata for volume 657edcae-ccaf-45a5-ac24-596a64f46bee backed by image a6d0c978-002e-4d46-ab92-a0880bff49c1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88119) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (880f838d-bea7-4d7f-ad1c-ff795a6ec03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-657edcae-ccaf-45a5-ac24-596a64f46bee', 'volume_size': 1, 'image_id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a6d0c978-002e-4d46-ab92-a0880bff49c1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9bf3eaae61a647cbbfcb8c7cdd60fe87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a6d0c978-002e-4d46-ab92-a0880bff49c1', 'created_at': datetime.datetime(2026, 7, 9, 22, 17, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 17, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a6d0c978-002e-4d46-ab92-a0880bff49c1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84628a05-d8b8-462b-a80c-7f8edec0d4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:51 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Volume volume-657edcae-ccaf-45a5-ac24-596a64f46bee (657edcae-ccaf-45a5-ac24-596a64f46bee): created successfully Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84628a05-d8b8-462b-a80c-7f8edec0d4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Flow 'volume_create_manager' (2c3f2759-995e-48da-a548-cc7fa3c730e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:51 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-3cd5a7d9-5fb5-487b-98d1-bc2ee30e27ed tempest-TestShelveInstance-314801032 None] Created volume successfully. Jul 10 00:38:52 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608796f8-c33c-42de-ab8a-2514d17df991 tempest-VolumeDependencyTests-857054667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea" returned: 0 in 0.753s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-608796f8-c33c-42de-ab8a-2514d17df991 tempest-VolumeDependencyTests-857054667 None] Lock "cinder-quobyte-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea" released by "delete_volume" :: held 1.744s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:52 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-608796f8-c33c-42de-ab8a-2514d17df991 tempest-VolumeDependencyTests-857054667 None] Created reservations ['74e5dd76-767b-47a5-8e27-8e8be5d4d986', 'abe945c6-e4a5-45f3-a2e5-185f25fdea6a', '72b20143-eecc-47a7-8d32-6941f73c816a', '1b513444-8ade-45a1-b460-bb368002c01a'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:38:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-608796f8-c33c-42de-ab8a-2514d17df991 tempest-VolumeDependencyTests-857054667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-608796f8-c33c-42de-ab8a-2514d17df991 tempest-VolumeDependencyTests-857054667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:52 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-608796f8-c33c-42de-ab8a-2514d17df991 tempest-VolumeDependencyTests-857054667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:52 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-608796f8-c33c-42de-ab8a-2514d17df991 tempest-VolumeDependencyTests-857054667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-608796f8-c33c-42de-ab8a-2514d17df991 tempest-VolumeDependencyTests-857054667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608796f8-c33c-42de-ab8a-2514d17df991 tempest-VolumeDependencyTests-857054667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:52 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:52 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:38:52 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7195f8a9-e978-4849-9944-e84615242d85 1073741824" returned: 0 in 1.012s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7195f8a9-e978-4849-9944-e84615242d85 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:52 devstack sudo[102732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7195f8a9-e978-4849-9944-e84615242d85 Jul 10 00:38:52 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:53 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7195f8a9-e978-4849-9944-e84615242d85" returned: 0 in 0.756s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:38:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35df5ae3-fe9b-4a89-bbbd-1767a0f50bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7195f8a9-e978-4849-9944-e84615242d85', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38df64d4-2cdf-4594-aea0-150395b505c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:38:53 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Volume volume-7195f8a9-e978-4849-9944-e84615242d85 (7195f8a9-e978-4849-9944-e84615242d85): created successfully Jul 10 00:38:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38df64d4-2cdf-4594-aea0-150395b505c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:38:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Flow 'volume_create_manager' (f1d201da-547a-428d-aaf5-a7d5f44ca01c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:38:53 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-608796f8-c33c-42de-ab8a-2514d17df991 tempest-VolumeDependencyTests-857054667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.951s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:53 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-608796f8-c33c-42de-ab8a-2514d17df991 tempest-VolumeDependencyTests-857054667 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:38:53 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-86cb0271-95c1-49e4-91b5-9eed5abedaff tempest-CreateVolumesFromSnapshotTest-1320363851 None] Created volume successfully. Jul 10 00:38:53 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-608796f8-c33c-42de-ab8a-2514d17df991 tempest-VolumeDependencyTests-857054667 None] Deleted volume successfully. Jul 10 00:38:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-608796f8-c33c-42de-ab8a-2514d17df991 tempest-VolumeDependencyTests-857054667 None] Lock "cinder-7d63b7a0-1cf0-4b5a-ab59-b80ae8c220ea-delete_volume" released by "delete_volume" :: held 2.959s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ecd5b813-b183-4915-a875-3a970b1bf9b3 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "cinder-7195f8a9-e978-4849-9944-e84615242d85-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ecd5b813-b183-4915-a875-3a970b1bf9b3 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-7195f8a9-e978-4849-9944-e84615242d85-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ecd5b813-b183-4915-a875-3a970b1bf9b3 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "cinder-quobyte-7195f8a9-e978-4849-9944-e84615242d85" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ecd5b813-b183-4915-a875-3a970b1bf9b3 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-quobyte-7195f8a9-e978-4849-9944-e84615242d85" acquired by "delete_volume" :: waited 0.020s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:53 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccbf9b4-5c92-47e0-a1d3-2a6e939767b6]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ecd5b813-b183-4915-a875-3a970b1bf9b3 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7195f8a9-e978-4849-9944-e84615242d85 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:53 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7195f8a9-e978-4849-9944-e84615242d85 Jul 10 00:38:53 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:54 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ecd5b813-b183-4915-a875-3a970b1bf9b3 tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7195f8a9-e978-4849-9944-e84615242d85" returned: 0 in 1.065s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ecd5b813-b183-4915-a875-3a970b1bf9b3 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7195f8a9-e978-4849-9944-e84615242d85 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:54 devstack sudo[102744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7195f8a9-e978-4849-9944-e84615242d85 Jul 10 00:38:54 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:55 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ecd5b813-b183-4915-a875-3a970b1bf9b3 tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7195f8a9-e978-4849-9944-e84615242d85" returned: 0 in 0.771s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:55 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ecd5b813-b183-4915-a875-3a970b1bf9b3 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-quobyte-7195f8a9-e978-4849-9944-e84615242d85" released by "delete_volume" :: held 1.883s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:55 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-ecd5b813-b183-4915-a875-3a970b1bf9b3 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Created reservations ['f93583e9-6bee-4f10-a31a-ef6d95369133', 'eebaae3f-df64-49ac-a877-4263a9f6e339', '67bada24-8d6b-4791-9aa6-913452c2495b', 'bd04371c-f940-4297-b8a3-bd4b95678755'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:38:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ecd5b813-b183-4915-a875-3a970b1bf9b3 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ecd5b813-b183-4915-a875-3a970b1bf9b3 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:55 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ecd5b813-b183-4915-a875-3a970b1bf9b3 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:55 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ecd5b813-b183-4915-a875-3a970b1bf9b3 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ecd5b813-b183-4915-a875-3a970b1bf9b3 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ecd5b813-b183-4915-a875-3a970b1bf9b3 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:55 devstack sudo[102748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:38:55 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:55 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-10f24f8e-13ba-4d92-b92c-e8174e716572 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "cinder-5202a7b4-8592-4537-a666-6f043e4235a0-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:55 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-10f24f8e-13ba-4d92-b92c-e8174e716572 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-5202a7b4-8592-4537-a666-6f043e4235a0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:56 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-10f24f8e-13ba-4d92-b92c-e8174e716572 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "cinder-quobyte-5202a7b4-8592-4537-a666-6f043e4235a0" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:56 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-10f24f8e-13ba-4d92-b92c-e8174e716572 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-quobyte-5202a7b4-8592-4537-a666-6f043e4235a0" acquired by "delete_volume" :: waited 0.028s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:56 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1ad164-0bc5-4e17-8c89-7d6d0aeee836]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-10f24f8e-13ba-4d92-b92c-e8174e716572 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5202a7b4-8592-4537-a666-6f043e4235a0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:56 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5202a7b4-8592-4537-a666-6f043e4235a0 Jul 10 00:38:56 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:56 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ecd5b813-b183-4915-a875-3a970b1bf9b3 tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.912s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:56 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-ecd5b813-b183-4915-a875-3a970b1bf9b3 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:38:56 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-ecd5b813-b183-4915-a875-3a970b1bf9b3 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Deleted volume successfully. Jul 10 00:38:56 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ecd5b813-b183-4915-a875-3a970b1bf9b3 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-7195f8a9-e978-4849-9944-e84615242d85-delete_volume" released by "delete_volume" :: held 3.106s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:57 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-10f24f8e-13ba-4d92-b92c-e8174e716572 tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5202a7b4-8592-4537-a666-6f043e4235a0" returned: 0 in 1.028s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-10f24f8e-13ba-4d92-b92c-e8174e716572 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5202a7b4-8592-4537-a666-6f043e4235a0 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:57 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5202a7b4-8592-4537-a666-6f043e4235a0 Jul 10 00:38:57 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:57 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-10f24f8e-13ba-4d92-b92c-e8174e716572 tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5202a7b4-8592-4537-a666-6f043e4235a0" returned: 0 in 0.720s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:57 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-10f24f8e-13ba-4d92-b92c-e8174e716572 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-quobyte-5202a7b4-8592-4537-a666-6f043e4235a0" released by "delete_volume" :: held 1.807s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:57 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-10f24f8e-13ba-4d92-b92c-e8174e716572 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Created reservations ['dfc36f1b-83fb-49ee-8d79-114ba8540d27', 'dd629b31-bfd9-49ed-a7a9-74a8f2074a23', '31eb6cd2-eff2-449a-9e2e-996c418e3062', '9c3ec7e6-90cd-4f74-9f64-0cac07a38def'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:38:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-10f24f8e-13ba-4d92-b92c-e8174e716572 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:38:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-10f24f8e-13ba-4d92-b92c-e8174e716572 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:38:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-10f24f8e-13ba-4d92-b92c-e8174e716572 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:38:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-10f24f8e-13ba-4d92-b92c-e8174e716572 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:38:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-10f24f8e-13ba-4d92-b92c-e8174e716572 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:38:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-10f24f8e-13ba-4d92-b92c-e8174e716572 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:58 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:38:58 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:58 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b81cd098-0042-43c7-bb7f-d7110258596c tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "cinder-bb1ea4ea-66b8-4dd3-b25a-eba672532724-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:58 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b81cd098-0042-43c7-bb7f-d7110258596c tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-bb1ea4ea-66b8-4dd3-b25a-eba672532724-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:58 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b81cd098-0042-43c7-bb7f-d7110258596c tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "cinder-quobyte-bb1ea4ea-66b8-4dd3-b25a-eba672532724" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:38:58 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b81cd098-0042-43c7-bb7f-d7110258596c tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-quobyte-bb1ea4ea-66b8-4dd3-b25a-eba672532724" acquired by "delete_volume" :: waited 0.033s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:38:58 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf077902-a9ab-4410-a3ea-6ac0e358f96b]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:38:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b81cd098-0042-43c7-bb7f-d7110258596c tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bb1ea4ea-66b8-4dd3-b25a-eba672532724 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:58 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bb1ea4ea-66b8-4dd3-b25a-eba672532724 Jul 10 00:38:58 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:38:59 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-10f24f8e-13ba-4d92-b92c-e8174e716572 tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.105s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:59 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-10f24f8e-13ba-4d92-b92c-e8174e716572 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:38:59 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-10f24f8e-13ba-4d92-b92c-e8174e716572 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Deleted volume successfully. Jul 10 00:38:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-10f24f8e-13ba-4d92-b92c-e8174e716572 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-5202a7b4-8592-4537-a666-6f043e4235a0-delete_volume" released by "delete_volume" :: held 3.229s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:38:59 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Jul 10 00:38:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b81cd098-0042-43c7-bb7f-d7110258596c tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bb1ea4ea-66b8-4dd3-b25a-eba672532724" returned: 0 in 1.136s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:38:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b81cd098-0042-43c7-bb7f-d7110258596c tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bb1ea4ea-66b8-4dd3-b25a-eba672532724 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:38:59 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bb1ea4ea-66b8-4dd3-b25a-eba672532724 Jul 10 00:38:59 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:00 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:39:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Flow 'volume_create_manager' (03b4866f-aaeb-4ea5-aeda-9af64020485c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f31e8b0-d9be-460e-8b9c-d889af2487ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f31e8b0-d9be-460e-8b9c-d889af2487ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83459155-bb34-49bf-b85d-803800f99ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60759eb97e1c433bb15b2b6a7f9bce99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:00Z,use_quota=True,user_id='3a074888b37b484987a5a90430af7646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfa35790-e2a2-44c4-b392-016e8c470485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfa35790-e2a2-44c4-b392-016e8c470485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c30433-5dc4-4e81-a57a-507b418bf73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:00 devstack cinder-volume[88119]: DEBUG cinder.image.glance [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Creating Keystone auth plugin from conf {{(pid=88119) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 00:39:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-4029206b-b386-4f22-b6b7-15c22268d78d req-1a732e6d-0c0a-4fcc-ba43-6dcd14bfb48e tempest-TestShelveInstance-314801032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-4029206b-b386-4f22-b6b7-15c22268d78d req-1a732e6d-0c0a-4fcc-ba43-6dcd14bfb48e tempest-TestShelveInstance-314801032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:00 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde19070-299e-4ed6-b6b5-e0180ed9dc4e]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-4029206b-b386-4f22-b6b7-15c22268d78d req-1a732e6d-0c0a-4fcc-ba43-6dcd14bfb48e tempest-TestShelveInstance-314801032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:00 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b81cd098-0042-43c7-bb7f-d7110258596c tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bb1ea4ea-66b8-4dd3-b25a-eba672532724" returned: 0 in 0.924s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b81cd098-0042-43c7-bb7f-d7110258596c tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-quobyte-bb1ea4ea-66b8-4dd3-b25a-eba672532724" released by "delete_volume" :: held 2.131s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:00 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee Jul 10 00:39:00 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:00 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-b81cd098-0042-43c7-bb7f-d7110258596c tempest-CreateVolumesFromSnapshotTest-1320363851 None] Created reservations ['1b633e30-0366-4e57-b7a5-5c141927e943', 'c7d8f18f-9824-4113-8c12-dbed5429a73e', '311faad5-6093-4afb-9dc3-40071a43c14c', '9d36e1e7-42a2-4f01-879e-3b2612cc0e5e'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:39:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c30433-5dc4-4e81-a57a-507b418bf73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '83459155-bb34-49bf-b85d-803800f99ef4', 'volume_name': 'volume-83459155-bb34-49bf-b85d-803800f99ef4', 'volume_size': 1, 'image_id': '92fd33b2-6ab8-4660-aa12-d7c66fda4d94', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92fd33b2-6ab8-4660-aa12-d7c66fda4d94', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7f40aee4d71e868762f7eb85033216c3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60759eb97e1c433bb15b2b6a7f9bce99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd1a8dba7864c760d9001035c81ef3816155f14da2e3f48bc4627b39471df41fe6050dcf5e8370d30b6dbe7a3c55e9812d182b8a83e31c3a5d7ce18ca993a7bbe', 'id': '92fd33b2-6ab8-4660-aa12-d7c66fda4d94', 'created_at': datetime.datetime(2026, 7, 9, 22, 38, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 38, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92fd33b2-6ab8-4660-aa12-d7c66fda4d94/file', 'properties': {}}, 'image_service': }' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01c6c6c-5fda-45f0-a162-bce8948d6518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01c6c6c-5fda-45f0-a162-bce8948d6518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f7a14a-7bb8-43a7-b5b1-2f30abb034ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:00 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Volume 83459155-bb34-49bf-b85d-803800f99ef4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-83459155-bb34-49bf-b85d-803800f99ef4', 'volume_size': 1, 'image_id': '92fd33b2-6ab8-4660-aa12-d7c66fda4d94', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92fd33b2-6ab8-4660-aa12-d7c66fda4d94', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7f40aee4d71e868762f7eb85033216c3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60759eb97e1c433bb15b2b6a7f9bce99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd1a8dba7864c760d9001035c81ef3816155f14da2e3f48bc4627b39471df41fe6050dcf5e8370d30b6dbe7a3c55e9812d182b8a83e31c3a5d7ce18ca993a7bbe', 'id': '92fd33b2-6ab8-4660-aa12-d7c66fda4d94', 'created_at': datetime.datetime(2026, 7, 9, 22, 38, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 38, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92fd33b2-6ab8-4660-aa12-d7c66fda4d94/file', 'properties': {}}, 'image_service': } Jul 10 00:39:00 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Trying to clone 83459155-bb34-49bf-b85d-803800f99ef4 from image 92fd33b2-6ab8-4660-aa12-d7c66fda4d94 at location (None, [{'url': 'file:///opt/stack/data/glance/images/92fd33b2-6ab8-4660-aa12-d7c66fda4d94', 'metadata': {}}]). {{(pid=88119) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 00:39:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b81cd098-0042-43c7-bb7f-d7110258596c tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b81cd098-0042-43c7-bb7f-d7110258596c tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b81cd098-0042-43c7-bb7f-d7110258596c tempest-CreateVolumesFromSnapshotTest-1320363851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b81cd098-0042-43c7-bb7f-d7110258596c tempest-CreateVolumesFromSnapshotTest-1320363851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b81cd098-0042-43c7-bb7f-d7110258596c tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b81cd098-0042-43c7-bb7f-d7110258596c tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:00 devstack sudo[102780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:39:00 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:01 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_5ovpjx3wdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 00:39:01 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Image download 0.00 MB at 0.00 MB/s Jul 10 00:39:01 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc952e6-de92-4214-8466-c713fa749e76]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_5ovpjx3wdevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:01 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_5ovpjx3wdevstack@QuobyteHD Jul 10 00:39:01 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:01 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a4c90247-286b-4d09-a988-ba7075b60e00 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "cinder-cf0b6f96-35da-4793-834f-0c64599bed79-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:01 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a4c90247-286b-4d09-a988-ba7075b60e00 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-cf0b6f96-35da-4793-834f-0c64599bed79-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:01 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b81cd098-0042-43c7-bb7f-d7110258596c tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.025s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:01 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-b81cd098-0042-43c7-bb7f-d7110258596c tempest-CreateVolumesFromSnapshotTest-1320363851 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:39:01 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-b81cd098-0042-43c7-bb7f-d7110258596c tempest-CreateVolumesFromSnapshotTest-1320363851 None] Deleted volume successfully. Jul 10 00:39:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a4c90247-286b-4d09-a988-ba7075b60e00 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "cinder-quobyte-cf0b6f96-35da-4793-834f-0c64599bed79" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:02 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-4029206b-b386-4f22-b6b7-15c22268d78d req-1a732e6d-0c0a-4fcc-ba43-6dcd14bfb48e tempest-TestShelveInstance-314801032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee" returned: 0 in 1.523s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-4029206b-b386-4f22-b6b7-15c22268d78d req-1a732e6d-0c0a-4fcc-ba43-6dcd14bfb48e tempest-TestShelveInstance-314801032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a4c90247-286b-4d09-a988-ba7075b60e00 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-quobyte-cf0b6f96-35da-4793-834f-0c64599bed79" acquired by "delete_volume" :: waited 0.065s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b81cd098-0042-43c7-bb7f-d7110258596c tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-bb1ea4ea-66b8-4dd3-b25a-eba672532724-delete_volume" released by "delete_volume" :: held 3.723s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:02 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea23744-a227-4036-b64c-c3241f5f5066]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a4c90247-286b-4d09-a988-ba7075b60e00 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cf0b6f96-35da-4793-834f-0c64599bed79 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:02 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee Jul 10 00:39:02 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:02 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cf0b6f96-35da-4793-834f-0c64599bed79 Jul 10 00:39:02 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:02 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_5ovpjx3wdevstack@QuobyteHD" returned: 0 in 1.532s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_5ovpjx3wdevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:03 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_5ovpjx3wdevstack@QuobyteHD Jul 10 00:39:03 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:03 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-4029206b-b386-4f22-b6b7-15c22268d78d req-1a732e6d-0c0a-4fcc-ba43-6dcd14bfb48e tempest-TestShelveInstance-314801032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee" returned: 1 in 1.301s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-4029206b-b386-4f22-b6b7-15c22268d78d req-1a732e6d-0c0a-4fcc-ba43-6dcd14bfb48e tempest-TestShelveInstance-314801032 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:39:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-4029206b-b386-4f22-b6b7-15c22268d78d req-1a732e6d-0c0a-4fcc-ba43-6dcd14bfb48e tempest-TestShelveInstance-314801032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.891s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:03 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a4c90247-286b-4d09-a988-ba7075b60e00 tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cf0b6f96-35da-4793-834f-0c64599bed79" returned: 0 in 1.236s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a4c90247-286b-4d09-a988-ba7075b60e00 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cf0b6f96-35da-4793-834f-0c64599bed79 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-4029206b-b386-4f22-b6b7-15c22268d78d req-1a732e6d-0c0a-4fcc-ba43-6dcd14bfb48e tempest-TestShelveInstance-314801032 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff', 'name': 'volume-657edcae-ccaf-45a5-ac24-596a64f46bee', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '663e7936-5f0f-4ad9-9357-25adc2f8c243', 'enforce_multipath': True} {{(pid=88119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 10 00:39:03 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cf0b6f96-35da-4793-834f-0c64599bed79 Jul 10 00:39:03 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:03 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-4029206b-b386-4f22-b6b7-15c22268d78d req-1a732e6d-0c0a-4fcc-ba43-6dcd14bfb48e tempest-TestShelveInstance-314801032 None] attachment_update completed successfully. Jul 10 00:39:04 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_5ovpjx3wdevstack@QuobyteHD" returned: 1 in 1.408s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_5ovpjx3wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:39:04 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Temporary image 92fd33b2-6ab8-4660-aa12-d7c66fda4d94 is fetched for user 3a074888b37b484987a5a90430af7646. {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 00:39:04 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b3720e-906a-4b37-963f-4cbf2d2c9952]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_5ovpjx3wdevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:04 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a4c90247-286b-4d09-a988-ba7075b60e00 tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-cf0b6f96-35da-4793-834f-0c64599bed79" returned: 0 in 0.990s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a4c90247-286b-4d09-a988-ba7075b60e00 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-quobyte-cf0b6f96-35da-4793-834f-0c64599bed79" released by "delete_volume" :: held 2.311s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:04 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_5ovpjx3wdevstack@QuobyteHD Jul 10 00:39:04 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:04 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-a4c90247-286b-4d09-a988-ba7075b60e00 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Created reservations ['00301947-4398-488a-ac79-c28fd87cde48', '0545d218-3629-416b-b7f9-551932a33e26', 'f6df4444-1f62-4aa4-bedb-427429e29445', '64b33f9d-1c07-46c0-b711-6da70d31d172'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:39:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a4c90247-286b-4d09-a988-ba7075b60e00 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a4c90247-286b-4d09-a988-ba7075b60e00 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:04 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a4c90247-286b-4d09-a988-ba7075b60e00 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:04 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a4c90247-286b-4d09-a988-ba7075b60e00 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a4c90247-286b-4d09-a988-ba7075b60e00 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a4c90247-286b-4d09-a988-ba7075b60e00 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:04 devstack sudo[102811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:39:04 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ba85066a-d074-493b-9ace-8d4b7ae9db9f tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "cinder-f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ba85066a-d074-493b-9ace-8d4b7ae9db9f tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ba85066a-d074-493b-9ace-8d4b7ae9db9f tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "cinder-quobyte-f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ba85066a-d074-493b-9ace-8d4b7ae9db9f tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-quobyte-f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5" acquired by "delete_volume" :: waited 0.046s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:04 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[22911f7c-4dee-4702-84a1-e6816e66abec]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ba85066a-d074-493b-9ace-8d4b7ae9db9f tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:05 devstack sudo[102813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5 Jul 10 00:39:05 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:05 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_5ovpjx3wdevstack@QuobyteHD" returned: 0 in 1.397s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_5ovpjx3wdevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:05 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_5ovpjx3wdevstack@QuobyteHD Jul 10 00:39:05 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:05 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a4c90247-286b-4d09-a988-ba7075b60e00 tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.322s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:05 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-a4c90247-286b-4d09-a988-ba7075b60e00 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:39:05 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-a4c90247-286b-4d09-a988-ba7075b60e00 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Deleted volume successfully. Jul 10 00:39:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a4c90247-286b-4d09-a988-ba7075b60e00 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-cf0b6f96-35da-4793-834f-0c64599bed79-delete_volume" released by "delete_volume" :: held 4.102s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:06 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ba85066a-d074-493b-9ace-8d4b7ae9db9f tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5" returned: 0 in 1.234s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ba85066a-d074-493b-9ace-8d4b7ae9db9f tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:06 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5 Jul 10 00:39:06 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:06 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_5ovpjx3wdevstack@QuobyteHD" returned: 1 in 0.945s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_5ovpjx3wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:39:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:06 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83459155-bb34-49bf-b85d-803800f99ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60759eb97e1c433bb15b2b6a7f9bce99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:00Z,use_quota=True,user_id='3a074888b37b484987a5a90430af7646',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:39:06 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Creating volume 83459155-bb34-49bf-b85d-803800f99ef4 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:39:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:06 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:06 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:06 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:39:06 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:39:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:06 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4 1073741824 Jul 10 00:39:06 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:06 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ba85066a-d074-493b-9ace-8d4b7ae9db9f tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5" returned: 0 in 0.711s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:06 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ba85066a-d074-493b-9ace-8d4b7ae9db9f tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-quobyte-f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5" released by "delete_volume" :: held 2.025s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:06 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-ba85066a-d074-493b-9ace-8d4b7ae9db9f tempest-CreateVolumesFromSnapshotTest-1320363851 None] Created reservations ['02ceb489-2b51-43f3-9bd6-7949e55c968f', 'feaeabc0-e1a2-4a25-861b-52add1762947', 'd0d2daed-75ce-41a1-bdc9-10de40ebf55a', '36bc9d09-5070-41b7-a997-b90cef661f9e'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:39:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ba85066a-d074-493b-9ace-8d4b7ae9db9f tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ba85066a-d074-493b-9ace-8d4b7ae9db9f tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ba85066a-d074-493b-9ace-8d4b7ae9db9f tempest-CreateVolumesFromSnapshotTest-1320363851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ba85066a-d074-493b-9ace-8d4b7ae9db9f tempest-CreateVolumesFromSnapshotTest-1320363851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ba85066a-d074-493b-9ace-8d4b7ae9db9f tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ba85066a-d074-493b-9ace-8d4b7ae9db9f tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:07 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:39:07 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:07 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4 1073741824" returned: 0 in 1.079s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:07 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4 Jul 10 00:39:07 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:07 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ba85066a-d074-493b-9ace-8d4b7ae9db9f tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.769s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:07 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-ba85066a-d074-493b-9ace-8d4b7ae9db9f tempest-CreateVolumesFromSnapshotTest-1320363851 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:39:07 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-ba85066a-d074-493b-9ace-8d4b7ae9db9f tempest-CreateVolumesFromSnapshotTest-1320363851 None] Deleted volume successfully. Jul 10 00:39:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ba85066a-d074-493b-9ace-8d4b7ae9db9f tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-f6d6b0c2-9248-43a3-9b38-4ccd8ba535f5-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-956922d7-9656-4689-be3c-dfc7899797a5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "cinder-e458c943-d41f-4123-bb96-d8442447eb81-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-956922d7-9656-4689-be3c-dfc7899797a5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-e458c943-d41f-4123-bb96-d8442447eb81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-956922d7-9656-4689-be3c-dfc7899797a5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "cinder-quobyte-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-956922d7-9656-4689-be3c-dfc7899797a5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-quobyte-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-956922d7-9656-4689-be3c-dfc7899797a5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "cinder-quobyte-e458c943-d41f-4123-bb96-d8442447eb81" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-956922d7-9656-4689-be3c-dfc7899797a5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-quobyte-e458c943-d41f-4123-bb96-d8442447eb81" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-956922d7-9656-4689-be3c-dfc7899797a5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Deleting offline snapshot e458c943-d41f-4123-bb96-d8442447eb81 of volume dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:39:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-956922d7-9656-4689-be3c-dfc7899797a5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] snapshot_file for this snap is: volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.e458c943-d41f-4123-bb96-d8442447eb81 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:39:08 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1e26df-ac1d-4985-b99f-42dbe0b7e74d]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-956922d7-9656-4689-be3c-dfc7899797a5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.e458c943-d41f-4123-bb96-d8442447eb81 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:08 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.e458c943-d41f-4123-bb96-d8442447eb81 Jul 10 00:39:08 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:08 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4" returned: 0 in 0.786s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] <== create_volume: return (1917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:39:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.923s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:08 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Attempting download of 92fd33b2-6ab8-4660-aa12-d7c66fda4d94 ((None, [{'url': 'file:///opt/stack/data/glance/images/92fd33b2-6ab8-4660-aa12-d7c66fda4d94', 'metadata': {}}])) to volume 83459155-bb34-49bf-b85d-803800f99ef4. {{(pid=88119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 00:39:08 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2b340f-6979-4f37-84be-86d9a69d5a4e]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_yw7ilp0t {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:08 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_yw7ilp0t Jul 10 00:39:08 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:09 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-956922d7-9656-4689-be3c-dfc7899797a5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.e458c943-d41f-4123-bb96-d8442447eb81" returned: 0 in 1.105s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:09 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-956922d7-9656-4689-be3c-dfc7899797a5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:39:09 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f68d09e-a645-4335-b714-0464ae300019]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-956922d7-9656-4689-be3c-dfc7899797a5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:09 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba Jul 10 00:39:09 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:09 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_yw7ilp0t" returned: 0 in 1.091s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_yw7ilp0t {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:09 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_yw7ilp0t Jul 10 00:39:09 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:10 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-956922d7-9656-4689-be3c-dfc7899797a5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba" returned: 0 in 1.068s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-956922d7-9656-4689-be3c-dfc7899797a5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.e458c943-d41f-4123-bb96-d8442447eb81 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:10 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.e458c943-d41f-4123-bb96-d8442447eb81 Jul 10 00:39:10 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:10 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_yw7ilp0t" returned: 1 in 0.929s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_yw7ilp0t' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:39:10 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad06138-296f-41f0-bb52-73b8dfa1758a]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_5ovpjx3wdevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:10 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_5ovpjx3wdevstack@QuobyteHD Jul 10 00:39:10 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:11 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-956922d7-9656-4689-be3c-dfc7899797a5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.e458c943-d41f-4123-bb96-d8442447eb81" returned: 0 in 1.048s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-956922d7-9656-4689-be3c-dfc7899797a5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.e458c943-d41f-4123-bb96-d8442447eb81 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:11 devstack sudo[103312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.e458c943-d41f-4123-bb96-d8442447eb81 Jul 10 00:39:11 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:11 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_5ovpjx3wdevstack@QuobyteHD" returned: 0 in 1.087s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_5ovpjx3wdevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:11 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_5ovpjx3wdevstack@QuobyteHD Jul 10 00:39:11 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:12 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-956922d7-9656-4689-be3c-dfc7899797a5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba.e458c943-d41f-4123-bb96-d8442447eb81" returned: 0 in 0.784s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:12 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-956922d7-9656-4689-be3c-dfc7899797a5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-quobyte-e458c943-d41f-4123-bb96-d8442447eb81" released by "_delete_snapshot" :: held 4.163s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:12 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-956922d7-9656-4689-be3c-dfc7899797a5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-quobyte-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba" released by "delete_snapshot" :: held 4.190s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:12 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-956922d7-9656-4689-be3c-dfc7899797a5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Created reservations ['658aaa01-5320-4b08-9e36-fe6c6cce6f15', '7f89e85e-dff9-4c9e-84d9-2dd6d4322860', '425e995e-5883-4c27-b6c2-b80216f6100d', '6e84c514-b159-48d2-9885-ea1548fdf2f4'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:39:12 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-956922d7-9656-4689-be3c-dfc7899797a5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Delete snapshot completed successfully. Jul 10 00:39:12 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-956922d7-9656-4689-be3c-dfc7899797a5 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-e458c943-d41f-4123-bb96-d8442447eb81-delete_snapshot" released by "delete_snapshot" :: held 4.403s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:12 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_5ovpjx3wdevstack@QuobyteHD" returned: 1 in 0.951s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_5ovpjx3wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:39:12 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] 92fd33b2-6ab8-4660-aa12-d7c66fda4d94 was raw, converting to raw {{(pid=88119) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 00:39:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_5ovpjx3wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:12 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_5ovpjx3wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4 Jul 10 00:39:12 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:13 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-53700dcf-7080-4c9a-bc32-8a934a391c13 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "cinder-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:13 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-53700dcf-7080-4c9a-bc32-8a934a391c13 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:13 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-53700dcf-7080-4c9a-bc32-8a934a391c13 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "cinder-quobyte-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:13 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-53700dcf-7080-4c9a-bc32-8a934a391c13 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-quobyte-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba" acquired by "delete_volume" :: waited 0.041s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:13 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1aff0e4-b7a1-499b-8fe6-efe56644326c]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-53700dcf-7080-4c9a-bc32-8a934a391c13 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:14 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba Jul 10 00:39:14 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:14 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_5ovpjx3wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4" returned: 0 in 1.672s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:14 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_92fd33b2-6ab8-4660-aa12-d7c66fda4d94_5ovpjx3wdevstack@QuobyteHD, size 0.00 MB, duration 1.68 sec, destination /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4 {{(pid=88119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:39:14 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 00:39:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:14 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4 1G Jul 10 00:39:14 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:15 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-53700dcf-7080-4c9a-bc32-8a934a391c13 tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba" returned: 0 in 1.429s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-53700dcf-7080-4c9a-bc32-8a934a391c13 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:15 devstack sudo[103337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba Jul 10 00:39:15 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:16 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4 1G" returned: 0 in 1.855s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:16 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae331ea1-4a6f-4f25-a2d6-9b53a07580f8]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:16 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4 Jul 10 00:39:16 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:16 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-53700dcf-7080-4c9a-bc32-8a934a391c13 tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba" returned: 0 in 1.429s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:16 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-53700dcf-7080-4c9a-bc32-8a934a391c13 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-quobyte-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba" released by "delete_volume" :: held 2.989s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:16 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-53700dcf-7080-4c9a-bc32-8a934a391c13 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Created reservations ['565ba4d5-122b-4172-b0e6-7e57ffc4b311', '2be1d2c4-1a85-4e61-8a13-381ebb04ae32', '0bf9aaf0-d016-42eb-b6fa-82be46fd88b9', '544bcbbe-f30b-4d9d-a421-35a067fd13bb'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:39:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-53700dcf-7080-4c9a-bc32-8a934a391c13 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-53700dcf-7080-4c9a-bc32-8a934a391c13 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-53700dcf-7080-4c9a-bc32-8a934a391c13 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-53700dcf-7080-4c9a-bc32-8a934a391c13 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-53700dcf-7080-4c9a-bc32-8a934a391c13 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-53700dcf-7080-4c9a-bc32-8a934a391c13 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:17 devstack sudo[103346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:39:17 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:18 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4" returned: 0 in 1.894s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:18 devstack sudo[103351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4 Jul 10 00:39:18 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:18 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-53700dcf-7080-4c9a-bc32-8a934a391c13 tempest-CreateVolumesFromSnapshotTest-1320363851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.509s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:18 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-53700dcf-7080-4c9a-bc32-8a934a391c13 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:39:18 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-53700dcf-7080-4c9a-bc32-8a934a391c13 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Deleted volume successfully. Jul 10 00:39:18 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-53700dcf-7080-4c9a-bc32-8a934a391c13 tempest-CreateVolumesFromSnapshotTest-1320363851 None] Lock "cinder-dd6822a4-3b99-4be7-9e0e-eb6ae3adc7ba-delete_volume" released by "delete_volume" :: held 5.019s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:19 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4" returned: 1 in 1.300s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:39:19 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Downloaded image 92fd33b2-6ab8-4660-aa12-d7c66fda4d94 ((None, [{'url': 'file:///opt/stack/data/glance/images/92fd33b2-6ab8-4660-aa12-d7c66fda4d94', 'metadata': {}}])) to volume 83459155-bb34-49bf-b85d-803800f99ef4 successfully. {{(pid=88119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 00:39:19 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Temporary image 92fd33b2-6ab8-4660-aa12-d7c66fda4d94 for user 3a074888b37b484987a5a90430af7646 is deleted. {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 00:39:19 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Marking volume 83459155-bb34-49bf-b85d-803800f99ef4 as bootable. {{(pid=88119) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 00:39:19 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Copying metadata from image 92fd33b2-6ab8-4660-aa12-d7c66fda4d94 to 83459155-bb34-49bf-b85d-803800f99ef4. {{(pid=88119) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 00:39:19 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Creating volume glance metadata for volume 83459155-bb34-49bf-b85d-803800f99ef4 backed by image 92fd33b2-6ab8-4660-aa12-d7c66fda4d94 with: {'image_id': '92fd33b2-6ab8-4660-aa12-d7c66fda4d94', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7f40aee4d71e868762f7eb85033216c3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88119) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 00:39:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f7a14a-7bb8-43a7-b5b1-2f30abb034ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83459155-bb34-49bf-b85d-803800f99ef4', 'volume_size': 1, 'image_id': '92fd33b2-6ab8-4660-aa12-d7c66fda4d94', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92fd33b2-6ab8-4660-aa12-d7c66fda4d94', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7f40aee4d71e868762f7eb85033216c3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60759eb97e1c433bb15b2b6a7f9bce99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd1a8dba7864c760d9001035c81ef3816155f14da2e3f48bc4627b39471df41fe6050dcf5e8370d30b6dbe7a3c55e9812d182b8a83e31c3a5d7ce18ca993a7bbe', 'id': '92fd33b2-6ab8-4660-aa12-d7c66fda4d94', 'created_at': datetime.datetime(2026, 7, 9, 22, 38, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 38, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92fd33b2-6ab8-4660-aa12-d7c66fda4d94/file', 'properties': {}}, 'image_service': }' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa054e7-6d3a-43b2-aa12-0ae664d58c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:19 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Volume volume-83459155-bb34-49bf-b85d-803800f99ef4 (83459155-bb34-49bf-b85d-803800f99ef4): created successfully Jul 10 00:39:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa054e7-6d3a-43b2-aa12-0ae664d58c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Flow 'volume_create_manager' (03b4866f-aaeb-4ea5-aeda-9af64020485c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:19 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-22772357-2ee4-4c11-81c2-fbb236fc9a76 tempest-VolumeImageDependencyTests-1303114253 None] Created volume successfully. Jul 10 00:39:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1e0a7e09-9db6-4fd3-aff9-209887dd2efa tempest-VolumeImageDependencyTests-1303114253 None] Acquiring lock "cinder-83459155-bb34-49bf-b85d-803800f99ef4-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:21 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1e0a7e09-9db6-4fd3-aff9-209887dd2efa tempest-VolumeImageDependencyTests-1303114253 None] Lock "cinder-83459155-bb34-49bf-b85d-803800f99ef4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:21 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1e0a7e09-9db6-4fd3-aff9-209887dd2efa tempest-VolumeImageDependencyTests-1303114253 None] Acquiring lock "cinder-quobyte-83459155-bb34-49bf-b85d-803800f99ef4" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:21 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1e0a7e09-9db6-4fd3-aff9-209887dd2efa tempest-VolumeImageDependencyTests-1303114253 None] Lock "cinder-quobyte-83459155-bb34-49bf-b85d-803800f99ef4" acquired by "delete_volume" :: waited 0.029s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:21 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[641061c9-d767-40ad-beea-8fdf6c6969ef]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1e0a7e09-9db6-4fd3-aff9-209887dd2efa tempest-VolumeImageDependencyTests-1303114253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:21 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4 Jul 10 00:39:21 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:22 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:UPDATE=112,cinder:SELECT=102,cinder:INSERT=41,cinder:DELETE=7 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:39:22 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:39:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Flow 'volume_create_manager' (78fb09d7-61e4-4b36-bd35-cd3f18fbac6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22c752c5-4cd3-4b38-879a-b3ff5f02f328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22c752c5-4cd3-4b38-879a-b3ff5f02f328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1482112808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7c07adf-b2a9-4f62-ae7c-588c37b7f802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3e9d06dc4724442b3da941aeffd6b13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:22Z,use_quota=True,user_id='358d62bc55a843a5a122616e3e387991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (377937d3-02d4-40a5-a0be-a9f8bea73744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (377937d3-02d4-40a5-a0be-a9f8bea73744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e47dc0f7-e647-47c5-ba39-7d7291c9aeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e47dc0f7-e647-47c5-ba39-7d7291c9aeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7c07adf-b2a9-4f62-ae7c-588c37b7f802', 'volume_name': 'volume-d7c07adf-b2a9-4f62-ae7c-588c37b7f802', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4acc16e5-6a11-46fa-b37f-4b13f7ba9174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4acc16e5-6a11-46fa-b37f-4b13f7ba9174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b210604d-59bb-4785-9db6-81ac6a14a6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:22 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Volume d7c07adf-b2a9-4f62-ae7c-588c37b7f802: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7c07adf-b2a9-4f62-ae7c-588c37b7f802', 'volume_size': 1} Jul 10 00:39:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:22 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1482112808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7c07adf-b2a9-4f62-ae7c-588c37b7f802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3e9d06dc4724442b3da941aeffd6b13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:22Z,use_quota=True,user_id='358d62bc55a843a5a122616e3e387991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:39:22 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Creating volume d7c07adf-b2a9-4f62-ae7c-588c37b7f802 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:39:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:22 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:22 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:22 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:39:22 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:39:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d7c07adf-b2a9-4f62-ae7c-588c37b7f802 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:22 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d7c07adf-b2a9-4f62-ae7c-588c37b7f802 1073741824 Jul 10 00:39:22 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:23 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1e0a7e09-9db6-4fd3-aff9-209887dd2efa tempest-VolumeImageDependencyTests-1303114253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4" returned: 0 in 1.864s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1e0a7e09-9db6-4fd3-aff9-209887dd2efa tempest-VolumeImageDependencyTests-1303114253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:23 devstack sudo[103364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4 Jul 10 00:39:23 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:23 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:39:23 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Flow 'volume_create_manager' (0d85583e-dedc-4405-b866-19faa0342791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:23 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f8dd7f-f51e-4096-8168-148d2540bbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:23 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f8dd7f-f51e-4096-8168-148d2540bbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-918638843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=517daeac-5297-4373-b3c1-a4c24279c1ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3e9d06dc4724442b3da941aeffd6b13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:23Z,use_quota=True,user_id='358d62bc55a843a5a122616e3e387991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:23 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba2c6958-20a6-486f-81c3-70517c05fadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:23 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba2c6958-20a6-486f-81c3-70517c05fadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:23 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (124aa231-2e7e-4a37-b81a-6a47e00c72ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:23 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (124aa231-2e7e-4a37-b81a-6a47e00c72ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '517daeac-5297-4373-b3c1-a4c24279c1ff', 'volume_name': 'volume-517daeac-5297-4373-b3c1-a4c24279c1ff', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:23 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1120eed6-4a15-46ed-8d98-5dee4e80e1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:23 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1120eed6-4a15-46ed-8d98-5dee4e80e1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:23 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642745b4-2cf4-4c38-8467-519811dc3f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:23 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Volume 517daeac-5297-4373-b3c1-a4c24279c1ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-517daeac-5297-4373-b3c1-a4c24279c1ff', 'volume_size': 1} Jul 10 00:39:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:24 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1e0a7e09-9db6-4fd3-aff9-209887dd2efa tempest-VolumeImageDependencyTests-1303114253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4" returned: 1 in 1.629s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1e0a7e09-9db6-4fd3-aff9-209887dd2efa tempest-VolumeImageDependencyTests-1303114253 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:39:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1e0a7e09-9db6-4fd3-aff9-209887dd2efa tempest-VolumeImageDependencyTests-1303114253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:24 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4 Jul 10 00:39:24 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:24 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d7c07adf-b2a9-4f62-ae7c-588c37b7f802 1073741824" returned: 0 in 2.506s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d7c07adf-b2a9-4f62-ae7c-588c37b7f802 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:25 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d7c07adf-b2a9-4f62-ae7c-588c37b7f802 Jul 10 00:39:25 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:26 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1e0a7e09-9db6-4fd3-aff9-209887dd2efa tempest-VolumeImageDependencyTests-1303114253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-83459155-bb34-49bf-b85d-803800f99ef4" returned: 0 in 1.309s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1e0a7e09-9db6-4fd3-aff9-209887dd2efa tempest-VolumeImageDependencyTests-1303114253 None] Lock "cinder-quobyte-83459155-bb34-49bf-b85d-803800f99ef4" released by "delete_volume" :: held 4.934s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:26 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d7c07adf-b2a9-4f62-ae7c-588c37b7f802" returned: 0 in 1.090s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] <== create_volume: return (3745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:39:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.752s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.627s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-918638843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=517daeac-5297-4373-b3c1-a4c24279c1ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3e9d06dc4724442b3da941aeffd6b13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:23Z,use_quota=True,user_id='358d62bc55a843a5a122616e3e387991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:39:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Creating volume 517daeac-5297-4373-b3c1-a4c24279c1ff {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:39:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:39:26 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:39:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-517daeac-5297-4373-b3c1-a4c24279c1ff 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b210604d-59bb-4785-9db6-81ac6a14a6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7c07adf-b2a9-4f62-ae7c-588c37b7f802', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d409d25d-5234-4744-a900-210fc692a009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:26 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Volume volume-d7c07adf-b2a9-4f62-ae7c-588c37b7f802 (d7c07adf-b2a9-4f62-ae7c-588c37b7f802): created successfully Jul 10 00:39:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d409d25d-5234-4744-a900-210fc692a009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:26 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-517daeac-5297-4373-b3c1-a4c24279c1ff 1073741824 Jul 10 00:39:26 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Flow 'volume_create_manager' (78fb09d7-61e4-4b36-bd35-cd3f18fbac6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:26 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-1e0a7e09-9db6-4fd3-aff9-209887dd2efa tempest-VolumeImageDependencyTests-1303114253 None] Created reservations ['e5c5f2e9-6e4a-4450-8c7a-818eb523fe0b', 'e205aa12-a56c-414e-a137-f2ab00cb5dbf', 'fe4843b9-94c9-495a-a2bd-06e56df3aff7', 'df7d92bf-e820-4418-b49f-c6d203bbf2e0'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:39:26 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-96b45d1a-0f3e-476f-a5b3-d81fce8ced5a tempest-TestServerVolumeAttachmentScenario-1587611986 None] Created volume successfully. Jul 10 00:39:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1e0a7e09-9db6-4fd3-aff9-209887dd2efa tempest-VolumeImageDependencyTests-1303114253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1e0a7e09-9db6-4fd3-aff9-209887dd2efa tempest-VolumeImageDependencyTests-1303114253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1e0a7e09-9db6-4fd3-aff9-209887dd2efa tempest-VolumeImageDependencyTests-1303114253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1e0a7e09-9db6-4fd3-aff9-209887dd2efa tempest-VolumeImageDependencyTests-1303114253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1e0a7e09-9db6-4fd3-aff9-209887dd2efa tempest-VolumeImageDependencyTests-1303114253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1e0a7e09-9db6-4fd3-aff9-209887dd2efa tempest-VolumeImageDependencyTests-1303114253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:26 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:39:26 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:28 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-517daeac-5297-4373-b3c1-a4c24279c1ff 1073741824" returned: 0 in 1.853s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-517daeac-5297-4373-b3c1-a4c24279c1ff {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:28 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1e0a7e09-9db6-4fd3-aff9-209887dd2efa tempest-VolumeImageDependencyTests-1303114253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.658s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:28 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-517daeac-5297-4373-b3c1-a4c24279c1ff Jul 10 00:39:28 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:28 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-1e0a7e09-9db6-4fd3-aff9-209887dd2efa tempest-VolumeImageDependencyTests-1303114253 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:39:28 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-1e0a7e09-9db6-4fd3-aff9-209887dd2efa tempest-VolumeImageDependencyTests-1303114253 None] Deleted volume successfully. Jul 10 00:39:28 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1e0a7e09-9db6-4fd3-aff9-209887dd2efa tempest-VolumeImageDependencyTests-1303114253 None] Lock "cinder-83459155-bb34-49bf-b85d-803800f99ef4-delete_volume" released by "delete_volume" :: held 7.177s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:29 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-517daeac-5297-4373-b3c1-a4c24279c1ff" returned: 0 in 1.091s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:29 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] <== create_volume: return (3029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:39:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.032s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642745b4-2cf4-4c38-8467-519811dc3f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-517daeac-5297-4373-b3c1-a4c24279c1ff', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab25f38-ba27-4416-ab54-4e33a237aec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:29 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=103,cinder:UPDATE=126,cinder:INSERT=36,cinder:DELETE=13 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:39:29 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Volume volume-517daeac-5297-4373-b3c1-a4c24279c1ff (517daeac-5297-4373-b3c1-a4c24279c1ff): created successfully Jul 10 00:39:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab25f38-ba27-4416-ab54-4e33a237aec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Flow 'volume_create_manager' (0d85583e-dedc-4405-b866-19faa0342791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:29 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-5eab480d-29f1-4f66-8175-9ffd8e031a2d tempest-TestServerVolumeAttachmentScenario-1587611986 None] Created volume successfully. Jul 10 00:39:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:39:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:31 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:39:31 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:31 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:39:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Flow 'volume_create_manager' (2c96a0e2-66ea-487f-9ec1-0a817f9727e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0442b407-729e-49f5-b7a8-b962930a6882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0442b407-729e-49f5-b7a8-b962930a6882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f32c2e7-d333-4c2f-ae70-d6af847ba278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3402093a866493392841f797df506f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:32Z,use_quota=True,user_id='0815f12571ac4339bbf625aa528133a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a2695f-192a-46cb-9851-6b9794347fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a2695f-192a-46cb-9851-6b9794347fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c7ab83-73ed-48d3-98d2-e71cc723fd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c7ab83-73ed-48d3-98d2-e71cc723fd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f32c2e7-d333-4c2f-ae70-d6af847ba278', 'volume_name': 'volume-1f32c2e7-d333-4c2f-ae70-d6af847ba278', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b9b5c3-761a-49f7-9f3e-49f8c345008b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b9b5c3-761a-49f7-9f3e-49f8c345008b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ae9cb5-36b8-490e-89f5-19f7616d5d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:32 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Volume 1f32c2e7-d333-4c2f-ae70-d6af847ba278: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f32c2e7-d333-4c2f-ae70-d6af847ba278', 'volume_size': 1} Jul 10 00:39:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f32c2e7-d333-4c2f-ae70-d6af847ba278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3402093a866493392841f797df506f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:32Z,use_quota=True,user_id='0815f12571ac4339bbf625aa528133a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:39:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Creating volume 1f32c2e7-d333-4c2f-ae70-d6af847ba278 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:39:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:39:32 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:39:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f32c2e7-d333-4c2f-ae70-d6af847ba278 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:32 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f32c2e7-d333-4c2f-ae70-d6af847ba278 1073741824 Jul 10 00:39:32 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:32 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.741s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:32 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:39:32 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:39:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 29 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:39:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:39:32 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f32c2e7-d333-4c2f-ae70-d6af847ba278 1073741824" returned: 0 in 0.882s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f32c2e7-d333-4c2f-ae70-d6af847ba278 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:32 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f32c2e7-d333-4c2f-ae70-d6af847ba278 Jul 10 00:39:32 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:33 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f32c2e7-d333-4c2f-ae70-d6af847ba278" returned: 0 in 0.682s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:39:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ae9cb5-36b8-490e-89f5-19f7616d5d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f32c2e7-d333-4c2f-ae70-d6af847ba278', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839c643d-66c2-404a-bc0d-753d41098120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:33 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Volume volume-1f32c2e7-d333-4c2f-ae70-d6af847ba278 (1f32c2e7-d333-4c2f-ae70-d6af847ba278): created successfully Jul 10 00:39:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839c643d-66c2-404a-bc0d-753d41098120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Flow 'volume_create_manager' (2c96a0e2-66ea-487f-9ec1-0a817f9727e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:33 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-ec286676-96b4-4a40-8d89-0be447322011 tempest-CinderUnicodeTest-1910375688 None] Created volume successfully. Jul 10 00:39:34 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:39:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Flow 'volume_create_manager' (b2406de8-50a5-43dd-bc80-26dd4ebfede8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31005f50-1e40-41c1-a740-43eddf76d9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31005f50-1e40-41c1-a740-43eddf76d9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1316581218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6fca2b8-15de-4843-b988-cb61a10a4d9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3402093a866493392841f797df506f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:34Z,use_quota=True,user_id='0815f12571ac4339bbf625aa528133a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1bf8b61-05b6-4d0a-9a23-2e2601c15d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1bf8b61-05b6-4d0a-9a23-2e2601c15d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86aceaee-eb4f-4fb5-8a3a-757eef90d8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86aceaee-eb4f-4fb5-8a3a-757eef90d8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6fca2b8-15de-4843-b988-cb61a10a4d9a', 'volume_name': 'volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3285b51a-dee4-4acb-ad73-c7307e55413b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3285b51a-dee4-4acb-ad73-c7307e55413b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20e808e-b617-4fcc-a42e-187156e1aa49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:34 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Volume c6fca2b8-15de-4843-b988-cb61a10a4d9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a', 'volume_size': 1} Jul 10 00:39:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:39:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1316581218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6fca2b8-15de-4843-b988-cb61a10a4d9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3402093a866493392841f797df506f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:39:34Z,use_quota=True,user_id='0815f12571ac4339bbf625aa528133a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:39:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Creating volume c6fca2b8-15de-4843-b988-cb61a10a4d9a {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:39:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:39:34 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:39:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:34 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a 1073741824 Jul 10 00:39:34 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:35 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a 1073741824" returned: 0 in 1.140s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:35 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a Jul 10 00:39:35 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:36 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a" returned: 0 in 0.938s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:36 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] <== create_volume: return (2132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:39:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.136s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20e808e-b617-4fcc-a42e-187156e1aa49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78efd890-69d7-4dc7-b7e4-361df270ecfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:39:36 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Volume volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a (c6fca2b8-15de-4843-b988-cb61a10a4d9a): created successfully Jul 10 00:39:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78efd890-69d7-4dc7-b7e4-361df270ecfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:39:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Flow 'volume_create_manager' (b2406de8-50a5-43dd-bc80-26dd4ebfede8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:39:36 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-86dda379-70e4-4cfd-8cf4-cc3e263df91a tempest-CinderUnicodeTest-1910375688 None] Created volume successfully. Jul 10 00:39:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-76e027c9-a040-440e-b68d-4a542ad701ef tempest-CinderUnicodeTest-1910375688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-76e027c9-a040-440e-b68d-4a542ad701ef tempest-CinderUnicodeTest-1910375688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-76e027c9-a040-440e-b68d-4a542ad701ef tempest-CinderUnicodeTest-1910375688 None] Creating offline snapshot ca67b273-2aa5-423f-9733-a78001927e0f of volume c6fca2b8-15de-4843-b988-cb61a10a4d9a {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:39:37 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[238ee1aa-b145-465d-91a3-3245af078d89]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-76e027c9-a040-440e-b68d-4a542ad701ef tempest-CinderUnicodeTest-1910375688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:38 devstack sudo[103542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a Jul 10 00:39:38 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:38 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-76e027c9-a040-440e-b68d-4a542ad701ef tempest-CinderUnicodeTest-1910375688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a" returned: 0 in 0.814s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-76e027c9-a040-440e-b68d-4a542ad701ef tempest-CinderUnicodeTest-1910375688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.ca67b273-2aa5-423f-9733-a78001927e0f 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:38 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.ca67b273-2aa5-423f-9733-a78001927e0f 1G Jul 10 00:39:38 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:39 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-76e027c9-a040-440e-b68d-4a542ad701ef tempest-CinderUnicodeTest-1910375688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.ca67b273-2aa5-423f-9733-a78001927e0f 1G" returned: 0 in 0.962s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-76e027c9-a040-440e-b68d-4a542ad701ef tempest-CinderUnicodeTest-1910375688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.ca67b273-2aa5-423f-9733-a78001927e0f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:39 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.ca67b273-2aa5-423f-9733-a78001927e0f Jul 10 00:39:39 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:40 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-76e027c9-a040-440e-b68d-4a542ad701ef tempest-CinderUnicodeTest-1910375688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.ca67b273-2aa5-423f-9733-a78001927e0f" returned: 0 in 0.708s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:40 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-76e027c9-a040-440e-b68d-4a542ad701ef tempest-CinderUnicodeTest-1910375688 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.ca67b273-2aa5-423f-9733-a78001927e0f is being set with open permissions: ugo+rw Jul 10 00:39:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-76e027c9-a040-440e-b68d-4a542ad701ef tempest-CinderUnicodeTest-1910375688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.ca67b273-2aa5-423f-9733-a78001927e0f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:40 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.ca67b273-2aa5-423f-9733-a78001927e0f Jul 10 00:39:40 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:41 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-76e027c9-a040-440e-b68d-4a542ad701ef tempest-CinderUnicodeTest-1910375688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.ca67b273-2aa5-423f-9733-a78001927e0f" returned: 0 in 0.940s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-76e027c9-a040-440e-b68d-4a542ad701ef tempest-CinderUnicodeTest-1910375688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:41 devstack sudo[103653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.info Jul 10 00:39:41 devstack sudo[103653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:42 devstack sudo[103653]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-76e027c9-a040-440e-b68d-4a542ad701ef tempest-CinderUnicodeTest-1910375688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.info" returned: 0 in 0.692s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:42 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-76e027c9-a040-440e-b68d-4a542ad701ef tempest-CinderUnicodeTest-1910375688 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.info is being set with open permissions: ugo+rw Jul 10 00:39:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-76e027c9-a040-440e-b68d-4a542ad701ef tempest-CinderUnicodeTest-1910375688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:42 devstack sudo[103660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.info Jul 10 00:39:42 devstack sudo[103660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:42 devstack sudo[103660]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-76e027c9-a040-440e-b68d-4a542ad701ef tempest-CinderUnicodeTest-1910375688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.info" returned: 0 in 0.661s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-76e027c9-a040-440e-b68d-4a542ad701ef tempest-CinderUnicodeTest-1910375688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.888s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:42 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-76e027c9-a040-440e-b68d-4a542ad701ef tempest-CinderUnicodeTest-1910375688 None] Create snapshot completed successfully Jul 10 00:39:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-52908cf2-cb1a-4ed7-8599-1738d39744e2 tempest-CinderUnicodeTest-1910375688 None] Acquiring lock "cinder-ca67b273-2aa5-423f-9733-a78001927e0f-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-52908cf2-cb1a-4ed7-8599-1738d39744e2 tempest-CinderUnicodeTest-1910375688 None] Lock "cinder-ca67b273-2aa5-423f-9733-a78001927e0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-52908cf2-cb1a-4ed7-8599-1738d39744e2 tempest-CinderUnicodeTest-1910375688 None] Acquiring lock "cinder-quobyte-c6fca2b8-15de-4843-b988-cb61a10a4d9a" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-52908cf2-cb1a-4ed7-8599-1738d39744e2 tempest-CinderUnicodeTest-1910375688 None] Lock "cinder-quobyte-c6fca2b8-15de-4843-b988-cb61a10a4d9a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-52908cf2-cb1a-4ed7-8599-1738d39744e2 tempest-CinderUnicodeTest-1910375688 None] Acquiring lock "cinder-quobyte-ca67b273-2aa5-423f-9733-a78001927e0f" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-52908cf2-cb1a-4ed7-8599-1738d39744e2 tempest-CinderUnicodeTest-1910375688 None] Lock "cinder-quobyte-ca67b273-2aa5-423f-9733-a78001927e0f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-52908cf2-cb1a-4ed7-8599-1738d39744e2 tempest-CinderUnicodeTest-1910375688 None] Deleting offline snapshot ca67b273-2aa5-423f-9733-a78001927e0f of volume c6fca2b8-15de-4843-b988-cb61a10a4d9a {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:39:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-52908cf2-cb1a-4ed7-8599-1738d39744e2 tempest-CinderUnicodeTest-1910375688 None] snapshot_file for this snap is: volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.ca67b273-2aa5-423f-9733-a78001927e0f {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:39:43 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d74799-8bc7-4cd1-95d9-b2099b4beecd]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-52908cf2-cb1a-4ed7-8599-1738d39744e2 tempest-CinderUnicodeTest-1910375688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.ca67b273-2aa5-423f-9733-a78001927e0f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:43 devstack sudo[103683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.ca67b273-2aa5-423f-9733-a78001927e0f Jul 10 00:39:43 devstack sudo[103683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:44 devstack sudo[103683]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-52908cf2-cb1a-4ed7-8599-1738d39744e2 tempest-CinderUnicodeTest-1910375688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.ca67b273-2aa5-423f-9733-a78001927e0f" returned: 0 in 0.933s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-52908cf2-cb1a-4ed7-8599-1738d39744e2 tempest-CinderUnicodeTest-1910375688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:39:44 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[3292f668-dc2b-4a4d-9d74-6d9953d7b0e8]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-52908cf2-cb1a-4ed7-8599-1738d39744e2 tempest-CinderUnicodeTest-1910375688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:44 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a Jul 10 00:39:44 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:45 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-52908cf2-cb1a-4ed7-8599-1738d39744e2 tempest-CinderUnicodeTest-1910375688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a" returned: 0 in 1.142s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-52908cf2-cb1a-4ed7-8599-1738d39744e2 tempest-CinderUnicodeTest-1910375688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.ca67b273-2aa5-423f-9733-a78001927e0f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:45 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.ca67b273-2aa5-423f-9733-a78001927e0f Jul 10 00:39:45 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:45 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-4e224b84-9c84-4f7c-857a-51019ca4124e req-f4f7290e-263c-47e3-b600-823901584016 tempest-TestShelveInstance-314801032 None] Terminate volume connection completed successfully. Jul 10 00:39:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-4e224b84-9c84-4f7c-857a-51019ca4124e req-f4f7290e-263c-47e3-b600-823901584016 tempest-TestShelveInstance-314801032 None] Deleting attachment 663e7936-5f0f-4ad9-9357-25adc2f8c243. {{(pid=88119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 10 00:39:46 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-52908cf2-cb1a-4ed7-8599-1738d39744e2 tempest-CinderUnicodeTest-1910375688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.ca67b273-2aa5-423f-9733-a78001927e0f" returned: 0 in 0.918s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-52908cf2-cb1a-4ed7-8599-1738d39744e2 tempest-CinderUnicodeTest-1910375688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.ca67b273-2aa5-423f-9733-a78001927e0f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:46 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.ca67b273-2aa5-423f-9733-a78001927e0f Jul 10 00:39:46 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:47 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-52908cf2-cb1a-4ed7-8599-1738d39744e2 tempest-CinderUnicodeTest-1910375688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a.ca67b273-2aa5-423f-9733-a78001927e0f" returned: 0 in 0.813s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-52908cf2-cb1a-4ed7-8599-1738d39744e2 tempest-CinderUnicodeTest-1910375688 None] Lock "cinder-quobyte-ca67b273-2aa5-423f-9733-a78001927e0f" released by "_delete_snapshot" :: held 3.970s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-52908cf2-cb1a-4ed7-8599-1738d39744e2 tempest-CinderUnicodeTest-1910375688 None] Lock "cinder-quobyte-c6fca2b8-15de-4843-b988-cb61a10a4d9a" released by "delete_snapshot" :: held 3.998s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:47 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-52908cf2-cb1a-4ed7-8599-1738d39744e2 tempest-CinderUnicodeTest-1910375688 None] Created reservations ['a8d87de3-347f-4853-944c-95c2c909cbdf', '18f25047-071d-42b9-bfec-0c72763619ac', '490d9ab2-ee05-4039-b6d9-3431fbf90317', '6b139731-751a-49a1-966c-19eae8718521'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:39:47 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-52908cf2-cb1a-4ed7-8599-1738d39744e2 tempest-CinderUnicodeTest-1910375688 None] Delete snapshot completed successfully. Jul 10 00:39:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-52908cf2-cb1a-4ed7-8599-1738d39744e2 tempest-CinderUnicodeTest-1910375688 None] Lock "cinder-ca67b273-2aa5-423f-9733-a78001927e0f-delete_snapshot" released by "delete_snapshot" :: held 4.209s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ed7d095f-47f5-4692-8ac8-e7f0195f79e6 tempest-CinderUnicodeTest-1910375688 None] Acquiring lock "cinder-c6fca2b8-15de-4843-b988-cb61a10a4d9a-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ed7d095f-47f5-4692-8ac8-e7f0195f79e6 tempest-CinderUnicodeTest-1910375688 None] Lock "cinder-c6fca2b8-15de-4843-b988-cb61a10a4d9a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ed7d095f-47f5-4692-8ac8-e7f0195f79e6 tempest-CinderUnicodeTest-1910375688 None] Acquiring lock "cinder-quobyte-c6fca2b8-15de-4843-b988-cb61a10a4d9a" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ed7d095f-47f5-4692-8ac8-e7f0195f79e6 tempest-CinderUnicodeTest-1910375688 None] Lock "cinder-quobyte-c6fca2b8-15de-4843-b988-cb61a10a4d9a" acquired by "delete_volume" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:47 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[510a37b1-a335-4bdc-9312-e5d8168b4cbc]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ed7d095f-47f5-4692-8ac8-e7f0195f79e6 tempest-CinderUnicodeTest-1910375688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:47 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a Jul 10 00:39:47 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:48 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ed7d095f-47f5-4692-8ac8-e7f0195f79e6 tempest-CinderUnicodeTest-1910375688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a" returned: 0 in 0.897s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ed7d095f-47f5-4692-8ac8-e7f0195f79e6 tempest-CinderUnicodeTest-1910375688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:48 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a Jul 10 00:39:48 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:49 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ed7d095f-47f5-4692-8ac8-e7f0195f79e6 tempest-CinderUnicodeTest-1910375688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c6fca2b8-15de-4843-b988-cb61a10a4d9a" returned: 0 in 0.711s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ed7d095f-47f5-4692-8ac8-e7f0195f79e6 tempest-CinderUnicodeTest-1910375688 None] Lock "cinder-quobyte-c6fca2b8-15de-4843-b988-cb61a10a4d9a" released by "delete_volume" :: held 1.700s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:49 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-ed7d095f-47f5-4692-8ac8-e7f0195f79e6 tempest-CinderUnicodeTest-1910375688 None] Created reservations ['47067472-a78d-4c3b-851d-6db95085feb9', 'af118812-1d02-4ffe-97de-8e93c0afb99b', 'b8e8e48e-69e9-4546-9014-46ecf72f66e4', 'c2fd134f-4628-47dc-9bd3-c41135d4c234'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:39:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ed7d095f-47f5-4692-8ac8-e7f0195f79e6 tempest-CinderUnicodeTest-1910375688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ed7d095f-47f5-4692-8ac8-e7f0195f79e6 tempest-CinderUnicodeTest-1910375688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ed7d095f-47f5-4692-8ac8-e7f0195f79e6 tempest-CinderUnicodeTest-1910375688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ed7d095f-47f5-4692-8ac8-e7f0195f79e6 tempest-CinderUnicodeTest-1910375688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ed7d095f-47f5-4692-8ac8-e7f0195f79e6 tempest-CinderUnicodeTest-1910375688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ed7d095f-47f5-4692-8ac8-e7f0195f79e6 tempest-CinderUnicodeTest-1910375688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:49 devstack sudo[103737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:39:49 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-28811bee-09fd-4510-bc4d-415ae27da397 tempest-CinderUnicodeTest-1910375688 None] Acquiring lock "cinder-1f32c2e7-d333-4c2f-ae70-d6af847ba278-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-28811bee-09fd-4510-bc4d-415ae27da397 tempest-CinderUnicodeTest-1910375688 None] Lock "cinder-1f32c2e7-d333-4c2f-ae70-d6af847ba278-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-28811bee-09fd-4510-bc4d-415ae27da397 tempest-CinderUnicodeTest-1910375688 None] Acquiring lock "cinder-quobyte-1f32c2e7-d333-4c2f-ae70-d6af847ba278" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:39:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-28811bee-09fd-4510-bc4d-415ae27da397 tempest-CinderUnicodeTest-1910375688 None] Lock "cinder-quobyte-1f32c2e7-d333-4c2f-ae70-d6af847ba278" acquired by "delete_volume" :: waited 0.017s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:39:49 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0968f5-416f-4cb0-894f-e5e984775ff0]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-28811bee-09fd-4510-bc4d-415ae27da397 tempest-CinderUnicodeTest-1910375688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f32c2e7-d333-4c2f-ae70-d6af847ba278 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:50 devstack sudo[103739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f32c2e7-d333-4c2f-ae70-d6af847ba278 Jul 10 00:39:50 devstack sudo[103739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:50 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ed7d095f-47f5-4692-8ac8-e7f0195f79e6 tempest-CinderUnicodeTest-1910375688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.762s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:50 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-ed7d095f-47f5-4692-8ac8-e7f0195f79e6 tempest-CinderUnicodeTest-1910375688 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:39:50 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-ed7d095f-47f5-4692-8ac8-e7f0195f79e6 tempest-CinderUnicodeTest-1910375688 None] Deleted volume successfully. Jul 10 00:39:50 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ed7d095f-47f5-4692-8ac8-e7f0195f79e6 tempest-CinderUnicodeTest-1910375688 None] Lock "cinder-c6fca2b8-15de-4843-b988-cb61a10a4d9a-delete_volume" released by "delete_volume" :: held 2.706s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:50 devstack sudo[103739]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-28811bee-09fd-4510-bc4d-415ae27da397 tempest-CinderUnicodeTest-1910375688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f32c2e7-d333-4c2f-ae70-d6af847ba278" returned: 0 in 0.786s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-28811bee-09fd-4510-bc4d-415ae27da397 tempest-CinderUnicodeTest-1910375688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f32c2e7-d333-4c2f-ae70-d6af847ba278 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:50 devstack sudo[103752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f32c2e7-d333-4c2f-ae70-d6af847ba278 Jul 10 00:39:50 devstack sudo[103752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:51 devstack sudo[103752]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-28811bee-09fd-4510-bc4d-415ae27da397 tempest-CinderUnicodeTest-1910375688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f32c2e7-d333-4c2f-ae70-d6af847ba278" returned: 0 in 0.706s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-4040018d-7402-495b-b715-dac727ad63de req-566138c3-5c8b-4320-a2cf-99e3f9ee6cff tempest-TestShelveInstance-314801032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-4040018d-7402-495b-b715-dac727ad63de req-566138c3-5c8b-4320-a2cf-99e3f9ee6cff tempest-TestShelveInstance-314801032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:51 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-28811bee-09fd-4510-bc4d-415ae27da397 tempest-CinderUnicodeTest-1910375688 None] Lock "cinder-quobyte-1f32c2e7-d333-4c2f-ae70-d6af847ba278" released by "delete_volume" :: held 1.536s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:51 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e05fa4e-34ae-42a6-afde-c9ca75bc780b]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:39:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-4040018d-7402-495b-b715-dac727ad63de req-566138c3-5c8b-4320-a2cf-99e3f9ee6cff tempest-TestShelveInstance-314801032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:51 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-28811bee-09fd-4510-bc4d-415ae27da397 tempest-CinderUnicodeTest-1910375688 None] Created reservations ['ceab163e-b76b-42a2-8e89-7e8541f75118', '9b645cc8-3445-4c3f-9d57-b3d9951dea81', '9de2f9c9-97c2-4143-9321-cf3c6738d1d9', '2493a98c-6a63-42a5-94f6-1c6443257375'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:39:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-28811bee-09fd-4510-bc4d-415ae27da397 tempest-CinderUnicodeTest-1910375688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:39:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-28811bee-09fd-4510-bc4d-415ae27da397 tempest-CinderUnicodeTest-1910375688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:39:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-28811bee-09fd-4510-bc4d-415ae27da397 tempest-CinderUnicodeTest-1910375688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:39:51 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee Jul 10 00:39:51 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-28811bee-09fd-4510-bc4d-415ae27da397 tempest-CinderUnicodeTest-1910375688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:39:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-28811bee-09fd-4510-bc4d-415ae27da397 tempest-CinderUnicodeTest-1910375688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-28811bee-09fd-4510-bc4d-415ae27da397 tempest-CinderUnicodeTest-1910375688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:51 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:39:51 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:52 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-4040018d-7402-495b-b715-dac727ad63de req-566138c3-5c8b-4320-a2cf-99e3f9ee6cff tempest-TestShelveInstance-314801032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee" returned: 0 in 0.865s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-4040018d-7402-495b-b715-dac727ad63de req-566138c3-5c8b-4320-a2cf-99e3f9ee6cff tempest-TestShelveInstance-314801032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:39:52 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-28811bee-09fd-4510-bc4d-415ae27da397 tempest-CinderUnicodeTest-1910375688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.787s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:52 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-28811bee-09fd-4510-bc4d-415ae27da397 tempest-CinderUnicodeTest-1910375688 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:39:52 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-28811bee-09fd-4510-bc4d-415ae27da397 tempest-CinderUnicodeTest-1910375688 None] Deleted volume successfully. Jul 10 00:39:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-28811bee-09fd-4510-bc4d-415ae27da397 tempest-CinderUnicodeTest-1910375688 None] Lock "cinder-1f32c2e7-d333-4c2f-ae70-d6af847ba278-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:39:52 devstack sudo[103770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee Jul 10 00:39:52 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:39:53 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root Jul 10 00:39:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-4040018d-7402-495b-b715-dac727ad63de req-566138c3-5c8b-4320-a2cf-99e3f9ee6cff tempest-TestShelveInstance-314801032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee" returned: 1 in 0.802s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:39:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-4040018d-7402-495b-b715-dac727ad63de req-566138c3-5c8b-4320-a2cf-99e3f9ee6cff tempest-TestShelveInstance-314801032 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:39:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-4040018d-7402-495b-b715-dac727ad63de req-566138c3-5c8b-4320-a2cf-99e3f9ee6cff tempest-TestShelveInstance-314801032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.706s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:39:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-4040018d-7402-495b-b715-dac727ad63de req-566138c3-5c8b-4320-a2cf-99e3f9ee6cff tempest-TestShelveInstance-314801032 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff', 'name': 'volume-657edcae-ccaf-45a5-ac24-596a64f46bee', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cabf331c-4d6f-4472-85e4-fa6ec4dd08f3', 'enforce_multipath': True} {{(pid=88119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 10 00:39:53 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-4040018d-7402-495b-b715-dac727ad63de req-566138c3-5c8b-4320-a2cf-99e3f9ee6cff tempest-TestShelveInstance-314801032 None] attachment_update completed successfully. Jul 10 00:40:03 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:DELETE=1,cinder:SELECT=37,cinder:UPDATE=29,cinder:INSERT=8 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:40:03 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=28,cinder:UPDATE=46,cinder:INSERT=11,cinder:DELETE=6 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:40:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-0cca24fb-0175-45c7-9f72-addb5fe623f5 req-9a789ea6-08d8-408e-aaa3-dd25e961a832 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-0cca24fb-0175-45c7-9f72-addb5fe623f5 req-9a789ea6-08d8-408e-aaa3-dd25e961a832 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:10 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54b1413-5cb7-443b-a082-e10a99234751]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-0cca24fb-0175-45c7-9f72-addb5fe623f5 req-9a789ea6-08d8-408e-aaa3-dd25e961a832 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d7c07adf-b2a9-4f62-ae7c-588c37b7f802 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:10 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d7c07adf-b2a9-4f62-ae7c-588c37b7f802 Jul 10 00:40:10 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:11 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-0cca24fb-0175-45c7-9f72-addb5fe623f5 req-9a789ea6-08d8-408e-aaa3-dd25e961a832 tempest-TestServerVolumeAttachmentScenario-1587611986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d7c07adf-b2a9-4f62-ae7c-588c37b7f802" returned: 0 in 0.766s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-0cca24fb-0175-45c7-9f72-addb5fe623f5 req-9a789ea6-08d8-408e-aaa3-dd25e961a832 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.782s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:11 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-0cca24fb-0175-45c7-9f72-addb5fe623f5 req-9a789ea6-08d8-408e-aaa3-dd25e961a832 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff', 'name': 'volume-d7c07adf-b2a9-4f62-ae7c-588c37b7f802', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '19bd0a04-dc88-4401-ac1f-966baab6f656', 'enforce_multipath': True} {{(pid=88119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 10 00:40:11 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-0cca24fb-0175-45c7-9f72-addb5fe623f5 req-9a789ea6-08d8-408e-aaa3-dd25e961a832 tempest-TestServerVolumeAttachmentScenario-1587611986 None] attachment_update completed successfully. Jul 10 00:40:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-ddeab8b3-8cbb-470c-8eb8-1bd4fe26f493 req-7ab9d1db-fb42-4cf4-bce2-b9d70c3e4839 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-ddeab8b3-8cbb-470c-8eb8-1bd4fe26f493 req-7ab9d1db-fb42-4cf4-bce2-b9d70c3e4839 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:20 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ef2b97-b40c-4581-9443-b24d497b2a8a]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-ddeab8b3-8cbb-470c-8eb8-1bd4fe26f493 req-7ab9d1db-fb42-4cf4-bce2-b9d70c3e4839 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-517daeac-5297-4373-b3c1-a4c24279c1ff {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:20 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-517daeac-5297-4373-b3c1-a4c24279c1ff Jul 10 00:40:20 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:21 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-ddeab8b3-8cbb-470c-8eb8-1bd4fe26f493 req-7ab9d1db-fb42-4cf4-bce2-b9d70c3e4839 tempest-TestServerVolumeAttachmentScenario-1587611986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-517daeac-5297-4373-b3c1-a4c24279c1ff" returned: 0 in 0.778s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-ddeab8b3-8cbb-470c-8eb8-1bd4fe26f493 req-7ab9d1db-fb42-4cf4-bce2-b9d70c3e4839 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.805s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:21 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-ddeab8b3-8cbb-470c-8eb8-1bd4fe26f493 req-7ab9d1db-fb42-4cf4-bce2-b9d70c3e4839 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff', 'name': 'volume-517daeac-5297-4373-b3c1-a4c24279c1ff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e75feb6-08f2-4cfe-993b-d89c2ef601ec', 'enforce_multipath': True} {{(pid=88119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 10 00:40:21 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-ddeab8b3-8cbb-470c-8eb8-1bd4fe26f493 req-7ab9d1db-fb42-4cf4-bce2-b9d70c3e4839 tempest-TestServerVolumeAttachmentScenario-1587611986 None] attachment_update completed successfully. Jul 10 00:40:27 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-668255be-59cc-48da-a4e5-0ec96fa630e6 req-90db7a4c-0b8b-4887-85e5-fe89139eaaf5 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Terminate volume connection completed successfully. Jul 10 00:40:27 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-668255be-59cc-48da-a4e5-0ec96fa630e6 req-90db7a4c-0b8b-4887-85e5-fe89139eaaf5 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Deleting attachment 7e75feb6-08f2-4cfe-993b-d89c2ef601ec. {{(pid=88119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 10 00:40:31 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-c9571497-e2b5-476e-8f1c-da421694e56c req-2c7defd0-cd00-4116-8c9c-74c08a3a734e tempest-TestServerVolumeAttachmentScenario-1587611986 None] Terminate volume connection completed successfully. Jul 10 00:40:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-c9571497-e2b5-476e-8f1c-da421694e56c req-2c7defd0-cd00-4116-8c9c-74c08a3a734e tempest-TestServerVolumeAttachmentScenario-1587611986 None] Deleting attachment 19bd0a04-dc88-4401-ac1f-966baab6f656. {{(pid=88119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 10 00:40:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:40:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:31 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:40:31 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:32 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.687s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:32 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:40:32 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:40:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 29 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:40:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:40:33 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-f43b99bb-3fce-4351-ae38-412ca19b83b3 req-fbe2824c-c37d-4d78-8fe6-620897c4ac7a tempest-TestShelveInstance-314801032 None] Terminate volume connection completed successfully. Jul 10 00:40:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-f43b99bb-3fce-4351-ae38-412ca19b83b3 req-fbe2824c-c37d-4d78-8fe6-620897c4ac7a tempest-TestShelveInstance-314801032 None] Deleting attachment cabf331c-4d6f-4472-85e4-fa6ec4dd08f3. {{(pid=88119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 10 00:40:34 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-f43b99bb-3fce-4351-ae38-412ca19b83b3 req-5ce07e8a-d67e-42f6-985f-6a8bb2dbcf8c tempest-TestShelveInstance-314801032 None] Acquiring lock "cinder-657edcae-ccaf-45a5-ac24-596a64f46bee-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:34 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-f43b99bb-3fce-4351-ae38-412ca19b83b3 req-5ce07e8a-d67e-42f6-985f-6a8bb2dbcf8c tempest-TestShelveInstance-314801032 None] Lock "cinder-657edcae-ccaf-45a5-ac24-596a64f46bee-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:34 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-f43b99bb-3fce-4351-ae38-412ca19b83b3 req-5ce07e8a-d67e-42f6-985f-6a8bb2dbcf8c tempest-TestShelveInstance-314801032 None] Acquiring lock "cinder-quobyte-657edcae-ccaf-45a5-ac24-596a64f46bee" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:34 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-f43b99bb-3fce-4351-ae38-412ca19b83b3 req-5ce07e8a-d67e-42f6-985f-6a8bb2dbcf8c tempest-TestShelveInstance-314801032 None] Lock "cinder-quobyte-657edcae-ccaf-45a5-ac24-596a64f46bee" acquired by "delete_volume" :: waited 0.014s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:34 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5130037-2c3f-4409-b7eb-77e1fb51ed1b]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-f43b99bb-3fce-4351-ae38-412ca19b83b3 req-5ce07e8a-d67e-42f6-985f-6a8bb2dbcf8c tempest-TestShelveInstance-314801032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:34 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee Jul 10 00:40:34 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:35 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-f43b99bb-3fce-4351-ae38-412ca19b83b3 req-5ce07e8a-d67e-42f6-985f-6a8bb2dbcf8c tempest-TestShelveInstance-314801032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee" returned: 0 in 0.746s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-f43b99bb-3fce-4351-ae38-412ca19b83b3 req-5ce07e8a-d67e-42f6-985f-6a8bb2dbcf8c tempest-TestShelveInstance-314801032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:35 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee Jul 10 00:40:35 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:36 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-f43b99bb-3fce-4351-ae38-412ca19b83b3 req-5ce07e8a-d67e-42f6-985f-6a8bb2dbcf8c tempest-TestShelveInstance-314801032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee" returned: 1 in 0.892s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-f43b99bb-3fce-4351-ae38-412ca19b83b3 req-5ce07e8a-d67e-42f6-985f-6a8bb2dbcf8c tempest-TestShelveInstance-314801032 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:40:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-f43b99bb-3fce-4351-ae38-412ca19b83b3 req-5ce07e8a-d67e-42f6-985f-6a8bb2dbcf8c tempest-TestShelveInstance-314801032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:36 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee Jul 10 00:40:36 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:36 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-f43b99bb-3fce-4351-ae38-412ca19b83b3 req-5ce07e8a-d67e-42f6-985f-6a8bb2dbcf8c tempest-TestShelveInstance-314801032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-657edcae-ccaf-45a5-ac24-596a64f46bee" returned: 0 in 0.697s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:36 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-f43b99bb-3fce-4351-ae38-412ca19b83b3 req-5ce07e8a-d67e-42f6-985f-6a8bb2dbcf8c tempest-TestShelveInstance-314801032 None] Lock "cinder-quobyte-657edcae-ccaf-45a5-ac24-596a64f46bee" released by "delete_volume" :: held 2.395s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:36 devstack cinder-volume[88119]: DEBUG cinder.quota [req-f43b99bb-3fce-4351-ae38-412ca19b83b3 req-5ce07e8a-d67e-42f6-985f-6a8bb2dbcf8c tempest-TestShelveInstance-314801032 None] Created reservations ['39703d94-a69d-4d51-a192-604d8de302cf', '196c22da-e9a5-4cb0-957b-3b9e058b6161', '086d5e5d-9d08-48cc-a02e-05748a6f18f0', '1f6f0c5b-7a9c-4c52-b8a3-3be03cc94daf'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:40:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-f43b99bb-3fce-4351-ae38-412ca19b83b3 req-5ce07e8a-d67e-42f6-985f-6a8bb2dbcf8c tempest-TestShelveInstance-314801032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-f43b99bb-3fce-4351-ae38-412ca19b83b3 req-5ce07e8a-d67e-42f6-985f-6a8bb2dbcf8c tempest-TestShelveInstance-314801032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:36 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [req-f43b99bb-3fce-4351-ae38-412ca19b83b3 req-5ce07e8a-d67e-42f6-985f-6a8bb2dbcf8c tempest-TestShelveInstance-314801032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:36 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [req-f43b99bb-3fce-4351-ae38-412ca19b83b3 req-5ce07e8a-d67e-42f6-985f-6a8bb2dbcf8c tempest-TestShelveInstance-314801032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-f43b99bb-3fce-4351-ae38-412ca19b83b3 req-5ce07e8a-d67e-42f6-985f-6a8bb2dbcf8c tempest-TestShelveInstance-314801032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-f43b99bb-3fce-4351-ae38-412ca19b83b3 req-5ce07e8a-d67e-42f6-985f-6a8bb2dbcf8c tempest-TestShelveInstance-314801032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:36 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:40:36 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:37 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-f43b99bb-3fce-4351-ae38-412ca19b83b3 req-5ce07e8a-d67e-42f6-985f-6a8bb2dbcf8c tempest-TestShelveInstance-314801032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.756s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:37 devstack cinder-volume[88119]: DEBUG cinder.manager [req-f43b99bb-3fce-4351-ae38-412ca19b83b3 req-5ce07e8a-d67e-42f6-985f-6a8bb2dbcf8c tempest-TestShelveInstance-314801032 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:40:37 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-f43b99bb-3fce-4351-ae38-412ca19b83b3 req-5ce07e8a-d67e-42f6-985f-6a8bb2dbcf8c tempest-TestShelveInstance-314801032 None] Deleted volume successfully. Jul 10 00:40:37 devstack cinder-volume[88119]: DEBUG cinder.coordination [req-f43b99bb-3fce-4351-ae38-412ca19b83b3 req-5ce07e8a-d67e-42f6-985f-6a8bb2dbcf8c tempest-TestShelveInstance-314801032 None] Lock "cinder-657edcae-ccaf-45a5-ac24-596a64f46bee-delete_volume" released by "delete_volume" :: held 3.364s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:41 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3670e8d0-bc23-4e05-a9e6-af5b10e4847b tempest-TestServerVolumeAttachmentScenario-1587611986 None] Acquiring lock "cinder-517daeac-5297-4373-b3c1-a4c24279c1ff-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:41 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3670e8d0-bc23-4e05-a9e6-af5b10e4847b tempest-TestServerVolumeAttachmentScenario-1587611986 None] Lock "cinder-517daeac-5297-4373-b3c1-a4c24279c1ff-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:41 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3670e8d0-bc23-4e05-a9e6-af5b10e4847b tempest-TestServerVolumeAttachmentScenario-1587611986 None] Acquiring lock "cinder-quobyte-517daeac-5297-4373-b3c1-a4c24279c1ff" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:41 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3670e8d0-bc23-4e05-a9e6-af5b10e4847b tempest-TestServerVolumeAttachmentScenario-1587611986 None] Lock "cinder-quobyte-517daeac-5297-4373-b3c1-a4c24279c1ff" acquired by "delete_volume" :: waited 0.014s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:41 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ce033f-9637-42e8-bf0c-485a690b1586]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3670e8d0-bc23-4e05-a9e6-af5b10e4847b tempest-TestServerVolumeAttachmentScenario-1587611986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-517daeac-5297-4373-b3c1-a4c24279c1ff {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:41 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-517daeac-5297-4373-b3c1-a4c24279c1ff Jul 10 00:40:41 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:42 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3670e8d0-bc23-4e05-a9e6-af5b10e4847b tempest-TestServerVolumeAttachmentScenario-1587611986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-517daeac-5297-4373-b3c1-a4c24279c1ff" returned: 0 in 0.748s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3670e8d0-bc23-4e05-a9e6-af5b10e4847b tempest-TestServerVolumeAttachmentScenario-1587611986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-517daeac-5297-4373-b3c1-a4c24279c1ff {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:42 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-517daeac-5297-4373-b3c1-a4c24279c1ff Jul 10 00:40:42 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:43 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3670e8d0-bc23-4e05-a9e6-af5b10e4847b tempest-TestServerVolumeAttachmentScenario-1587611986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-517daeac-5297-4373-b3c1-a4c24279c1ff" returned: 0 in 0.651s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3670e8d0-bc23-4e05-a9e6-af5b10e4847b tempest-TestServerVolumeAttachmentScenario-1587611986 None] Lock "cinder-quobyte-517daeac-5297-4373-b3c1-a4c24279c1ff" released by "delete_volume" :: held 1.437s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:43 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-3670e8d0-bc23-4e05-a9e6-af5b10e4847b tempest-TestServerVolumeAttachmentScenario-1587611986 None] Created reservations ['9c39c1cb-6428-4523-a6c7-f5b8b2c6aba9', '55a5742a-8531-4ca7-91aa-6c8c642644b6', 'b129bf53-e77d-45ab-b689-772a1931b279', 'ee01aacd-0966-4d08-9c4a-2e0a0b1535ef'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:40:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3670e8d0-bc23-4e05-a9e6-af5b10e4847b tempest-TestServerVolumeAttachmentScenario-1587611986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3670e8d0-bc23-4e05-a9e6-af5b10e4847b tempest-TestServerVolumeAttachmentScenario-1587611986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-3670e8d0-bc23-4e05-a9e6-af5b10e4847b tempest-TestServerVolumeAttachmentScenario-1587611986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-3670e8d0-bc23-4e05-a9e6-af5b10e4847b tempest-TestServerVolumeAttachmentScenario-1587611986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3670e8d0-bc23-4e05-a9e6-af5b10e4847b tempest-TestServerVolumeAttachmentScenario-1587611986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3670e8d0-bc23-4e05-a9e6-af5b10e4847b tempest-TestServerVolumeAttachmentScenario-1587611986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:43 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:40:43 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-01f90115-7037-42ff-aae9-2588f044d825 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Acquiring lock "cinder-d7c07adf-b2a9-4f62-ae7c-588c37b7f802-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-01f90115-7037-42ff-aae9-2588f044d825 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Lock "cinder-d7c07adf-b2a9-4f62-ae7c-588c37b7f802-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:43 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-01f90115-7037-42ff-aae9-2588f044d825 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Acquiring lock "cinder-quobyte-d7c07adf-b2a9-4f62-ae7c-588c37b7f802" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:40:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3670e8d0-bc23-4e05-a9e6-af5b10e4847b tempest-TestServerVolumeAttachmentScenario-1587611986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.684s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:43 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-3670e8d0-bc23-4e05-a9e6-af5b10e4847b tempest-TestServerVolumeAttachmentScenario-1587611986 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:40:43 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-3670e8d0-bc23-4e05-a9e6-af5b10e4847b tempest-TestServerVolumeAttachmentScenario-1587611986 None] Deleted volume successfully. Jul 10 00:40:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-01f90115-7037-42ff-aae9-2588f044d825 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Lock "cinder-quobyte-d7c07adf-b2a9-4f62-ae7c-588c37b7f802" acquired by "delete_volume" :: waited 0.026s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:40:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3670e8d0-bc23-4e05-a9e6-af5b10e4847b tempest-TestServerVolumeAttachmentScenario-1587611986 None] Lock "cinder-517daeac-5297-4373-b3c1-a4c24279c1ff-delete_volume" released by "delete_volume" :: held 2.334s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:43 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a9d65d-dfb3-461e-b031-592ee95ecdd2]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:40:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-01f90115-7037-42ff-aae9-2588f044d825 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d7c07adf-b2a9-4f62-ae7c-588c37b7f802 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:44 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d7c07adf-b2a9-4f62-ae7c-588c37b7f802 Jul 10 00:40:44 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:44 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-01f90115-7037-42ff-aae9-2588f044d825 tempest-TestServerVolumeAttachmentScenario-1587611986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d7c07adf-b2a9-4f62-ae7c-588c37b7f802" returned: 0 in 0.796s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-01f90115-7037-42ff-aae9-2588f044d825 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d7c07adf-b2a9-4f62-ae7c-588c37b7f802 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:44 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d7c07adf-b2a9-4f62-ae7c-588c37b7f802 Jul 10 00:40:44 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:45 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-01f90115-7037-42ff-aae9-2588f044d825 tempest-TestServerVolumeAttachmentScenario-1587611986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d7c07adf-b2a9-4f62-ae7c-588c37b7f802" returned: 0 in 0.647s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-01f90115-7037-42ff-aae9-2588f044d825 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Lock "cinder-quobyte-d7c07adf-b2a9-4f62-ae7c-588c37b7f802" released by "delete_volume" :: held 1.506s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:45 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-01f90115-7037-42ff-aae9-2588f044d825 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Created reservations ['2c53779b-d4f2-434f-8478-46daae2253ba', '2d12f8c5-bda7-4a9a-bc1b-87b52a265169', '4140dd1a-cc38-4929-9b99-d8df4d2626fa', '2c4e80b8-0d0b-444c-a21d-a1158abb7e57'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:40:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-01f90115-7037-42ff-aae9-2588f044d825 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-01f90115-7037-42ff-aae9-2588f044d825 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-01f90115-7037-42ff-aae9-2588f044d825 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-01f90115-7037-42ff-aae9-2588f044d825 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-01f90115-7037-42ff-aae9-2588f044d825 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-01f90115-7037-42ff-aae9-2588f044d825 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:45 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:40:45 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:46 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-01f90115-7037-42ff-aae9-2588f044d825 tempest-TestServerVolumeAttachmentScenario-1587611986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.676s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:46 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-01f90115-7037-42ff-aae9-2588f044d825 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:40:46 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-01f90115-7037-42ff-aae9-2588f044d825 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Deleted volume successfully. Jul 10 00:40:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-01f90115-7037-42ff-aae9-2588f044d825 tempest-TestServerVolumeAttachmentScenario-1587611986 None] Lock "cinder-d7c07adf-b2a9-4f62-ae7c-588c37b7f802-delete_volume" released by "delete_volume" :: held 2.395s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:40:48 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:40:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Flow 'volume_create_manager' (dcb70eec-9758-4038-8a8b-5980349228ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03594ee3-648d-4202-9c91-222eac7f5147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03594ee3-648d-4202-9c91-222eac7f5147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1043875682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95b69b38-8e54-454a-9a12-df266dbf6ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11ea8624f674e61a98382396248c7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:48Z,use_quota=True,user_id='3f5370acf84647d3af6ef9042ba98abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d541bad8-5c80-4d4b-a5cd-62932abfaf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d541bad8-5c80-4d4b-a5cd-62932abfaf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf857bc-7e97-4297-ad8c-0e9f4a090ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdf857bc-7e97-4297-ad8c-0e9f4a090ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95b69b38-8e54-454a-9a12-df266dbf6ade', 'volume_name': 'volume-95b69b38-8e54-454a-9a12-df266dbf6ade', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4754c51b-1166-4bb2-afd2-b3544a791ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4754c51b-1166-4bb2-afd2-b3544a791ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d77db2-0cd6-438b-a712-d7cc26955052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:48 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Volume 95b69b38-8e54-454a-9a12-df266dbf6ade: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95b69b38-8e54-454a-9a12-df266dbf6ade', 'volume_size': 1} Jul 10 00:40:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1043875682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95b69b38-8e54-454a-9a12-df266dbf6ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11ea8624f674e61a98382396248c7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:48Z,use_quota=True,user_id='3f5370acf84647d3af6ef9042ba98abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:40:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Creating volume 95b69b38-8e54-454a-9a12-df266dbf6ade {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:40:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:40:48 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:40:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-95b69b38-8e54-454a-9a12-df266dbf6ade 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:48 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-95b69b38-8e54-454a-9a12-df266dbf6ade 1073741824 Jul 10 00:40:48 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:49 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-95b69b38-8e54-454a-9a12-df266dbf6ade 1073741824" returned: 0 in 0.842s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-95b69b38-8e54-454a-9a12-df266dbf6ade {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:49 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-95b69b38-8e54-454a-9a12-df266dbf6ade Jul 10 00:40:49 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:49 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-95b69b38-8e54-454a-9a12-df266dbf6ade" returned: 0 in 0.669s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:40:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d77db2-0cd6-438b-a712-d7cc26955052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95b69b38-8e54-454a-9a12-df266dbf6ade', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f75e34da-667f-4a5e-879e-92cb42799b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:49 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Volume volume-95b69b38-8e54-454a-9a12-df266dbf6ade (95b69b38-8e54-454a-9a12-df266dbf6ade): created successfully Jul 10 00:40:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f75e34da-667f-4a5e-879e-92cb42799b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:49 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Flow 'volume_create_manager' (dcb70eec-9758-4038-8a8b-5980349228ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:49 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-105b8769-6560-4818-a8ac-421643623fc5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Created volume successfully. Jul 10 00:40:50 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:40:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Flow 'volume_create_manager' (8ea06444-58e8-4b67-b977-75a2e7ca727d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e878f7a-93c8-4311-851b-3d5cdc99d318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e878f7a-93c8-4311-851b-3d5cdc99d318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-623400607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b4502a-565e-4b64-86bd-9bc8d9aa8ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11ea8624f674e61a98382396248c7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:51Z,use_quota=True,user_id='3f5370acf84647d3af6ef9042ba98abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c816622d-3e36-4964-ab07-d2278a2531ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c816622d-3e36-4964-ab07-d2278a2531ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e03e77-b7b3-4971-bca4-8d700a70ea13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e03e77-b7b3-4971-bca4-8d700a70ea13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59b4502a-565e-4b64-86bd-9bc8d9aa8ef1', 'volume_name': 'volume-59b4502a-565e-4b64-86bd-9bc8d9aa8ef1', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ce8605-0686-4b66-9cb0-9f289bcf95f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40ce8605-0686-4b66-9cb0-9f289bcf95f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af2997a-24c8-4b25-93bc-38fc9806cd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:51 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Volume 59b4502a-565e-4b64-86bd-9bc8d9aa8ef1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59b4502a-565e-4b64-86bd-9bc8d9aa8ef1', 'volume_size': 1} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-623400607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b4502a-565e-4b64-86bd-9bc8d9aa8ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11ea8624f674e61a98382396248c7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:51Z,use_quota=True,user_id='3f5370acf84647d3af6ef9042ba98abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Creating volume 59b4502a-565e-4b64-86bd-9bc8d9aa8ef1 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:40:51 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b4502a-565e-4b64-86bd-9bc8d9aa8ef1 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:51 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b4502a-565e-4b64-86bd-9bc8d9aa8ef1 1073741824 Jul 10 00:40:51 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Flow 'volume_create_manager' (453ff5fe-5210-4c92-9aa8-62f93b70b16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad3c4ae-a515-4d85-815c-674171f5576b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad3c4ae-a515-4d85-815c-674171f5576b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-36522070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98222128-f4e9-4e1f-9610-07ee85a6e47d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11ea8624f674e61a98382396248c7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:51Z,use_quota=True,user_id='3f5370acf84647d3af6ef9042ba98abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f4528fe-cb46-473b-a824-2051de634724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f4528fe-cb46-473b-a824-2051de634724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dff10bd-0266-4b20-bcbd-47c3d08007ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dff10bd-0266-4b20-bcbd-47c3d08007ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98222128-f4e9-4e1f-9610-07ee85a6e47d', 'volume_name': 'volume-98222128-f4e9-4e1f-9610-07ee85a6e47d', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75741b40-ba5f-4229-acc7-39b5574ef952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75741b40-ba5f-4229-acc7-39b5574ef952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1bd6a12-4f94-4ed1-b6ba-95267bc4df2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:51 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Volume 98222128-f4e9-4e1f-9610-07ee85a6e47d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98222128-f4e9-4e1f-9610-07ee85a6e47d', 'volume_size': 1} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Flow 'volume_create_manager' (ffdd8d71-8579-453a-ac26-9aab2bf8996c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e3ffd1-26ba-4ee1-ad9d-72a29075c022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e3ffd1-26ba-4ee1-ad9d-72a29075c022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1125531171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f400da5-9de7-46d4-b132-a5e4e8e92dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11ea8624f674e61a98382396248c7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:52Z,use_quota=True,user_id='3f5370acf84647d3af6ef9042ba98abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (178e79ae-41f0-4678-806c-5834e98d7631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (178e79ae-41f0-4678-806c-5834e98d7631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8f791d-58d8-44b0-99c5-d700024f8305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8f791d-58d8-44b0-99c5-d700024f8305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f400da5-9de7-46d4-b132-a5e4e8e92dd4', 'volume_name': 'volume-1f400da5-9de7-46d4-b132-a5e4e8e92dd4', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3342d5bc-09f4-4147-bcf2-78175e0c6d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3342d5bc-09f4-4147-bcf2-78175e0c6d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01eba406-ae89-41fc-b68d-4c8332766416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:51 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Volume 1f400da5-9de7-46d4-b132-a5e4e8e92dd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f400da5-9de7-46d4-b132-a5e4e8e92dd4', 'volume_size': 1} Jul 10 00:40:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:52 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b4502a-565e-4b64-86bd-9bc8d9aa8ef1 1073741824" returned: 0 in 1.095s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b4502a-565e-4b64-86bd-9bc8d9aa8ef1 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:52 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b4502a-565e-4b64-86bd-9bc8d9aa8ef1 Jul 10 00:40:52 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:52 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:40:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Flow 'volume_create_manager' (42c1901e-d2ba-4fe6-82c1-16b4aeab63f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171e217e-9d8d-40de-b1f7-cf5bd30e2721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171e217e-9d8d-40de-b1f7-cf5bd30e2721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-232042144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49489ad9-6e89-4e62-8645-7b9bda63f6d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11ea8624f674e61a98382396248c7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:52Z,use_quota=True,user_id='3f5370acf84647d3af6ef9042ba98abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0bb8afc-5bcc-4e81-8a52-9dfe02722397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0bb8afc-5bcc-4e81-8a52-9dfe02722397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011305f8-3fff-4b75-b11c-be9eb47b29a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011305f8-3fff-4b75-b11c-be9eb47b29a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49489ad9-6e89-4e62-8645-7b9bda63f6d9', 'volume_name': 'volume-49489ad9-6e89-4e62-8645-7b9bda63f6d9', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21fee99b-c16f-42b7-8b0e-498788ba0de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21fee99b-c16f-42b7-8b0e-498788ba0de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66990367-8ab0-4a7e-99d8-8f00cce9f430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:52 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Volume 49489ad9-6e89-4e62-8645-7b9bda63f6d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49489ad9-6e89-4e62-8645-7b9bda63f6d9', 'volume_size': 1} Jul 10 00:40:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:52 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:40:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Flow 'volume_create_manager' (837610c4-e016-4608-8279-d43fd0aff026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab3f498-a9a8-4cf9-ac0c-376c8c0fbfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab3f498-a9a8-4cf9-ac0c-376c8c0fbfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-402408851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75fb5ade-1d00-487e-8469-8986254d3cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11ea8624f674e61a98382396248c7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:53Z,use_quota=True,user_id='3f5370acf84647d3af6ef9042ba98abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ccecb9-5c5a-4101-b298-739c5b3d0bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ccecb9-5c5a-4101-b298-739c5b3d0bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429ceda4-9bf0-4d08-811f-1f785a2b5807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429ceda4-9bf0-4d08-811f-1f785a2b5807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75fb5ade-1d00-487e-8469-8986254d3cc1', 'volume_name': 'volume-75fb5ade-1d00-487e-8469-8986254d3cc1', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4167d821-6b6b-410f-87b9-42b6ec287eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4167d821-6b6b-410f-87b9-42b6ec287eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4013da64-2606-43b3-9d49-65f2ac11e4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:52 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Volume 75fb5ade-1d00-487e-8469-8986254d3cc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75fb5ade-1d00-487e-8469-8986254d3cc1', 'volume_size': 1} Jul 10 00:40:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:53 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b4502a-565e-4b64-86bd-9bc8d9aa8ef1" returned: 0 in 0.857s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] <== create_volume: return (2021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:40:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.023s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.466s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-36522070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98222128-f4e9-4e1f-9610-07ee85a6e47d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11ea8624f674e61a98382396248c7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:51Z,use_quota=True,user_id='3f5370acf84647d3af6ef9042ba98abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:40:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Creating volume 98222128-f4e9-4e1f-9610-07ee85a6e47d {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:40:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:40:53 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:40:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-98222128-f4e9-4e1f-9610-07ee85a6e47d 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:53 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-98222128-f4e9-4e1f-9610-07ee85a6e47d 1073741824 Jul 10 00:40:53 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af2997a-24c8-4b25-93bc-38fc9806cd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59b4502a-565e-4b64-86bd-9bc8d9aa8ef1', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5807e31a-a2e4-49ae-b518-cc6a4f290ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:53 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Volume volume-59b4502a-565e-4b64-86bd-9bc8d9aa8ef1 (59b4502a-565e-4b64-86bd-9bc8d9aa8ef1): created successfully Jul 10 00:40:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5807e31a-a2e4-49ae-b518-cc6a4f290ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Flow 'volume_create_manager' (8ea06444-58e8-4b67-b977-75a2e7ca727d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:53 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-1227b148-e446-41ee-bf44-22f6cdc1bf8b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Created volume successfully. Jul 10 00:40:53 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-98222128-f4e9-4e1f-9610-07ee85a6e47d 1073741824" returned: 0 in 0.932s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-98222128-f4e9-4e1f-9610-07ee85a6e47d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:54 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-98222128-f4e9-4e1f-9610-07ee85a6e47d Jul 10 00:40:54 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:54 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-98222128-f4e9-4e1f-9610-07ee85a6e47d" returned: 0 in 0.685s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:40:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.799s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1125531171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f400da5-9de7-46d4-b132-a5e4e8e92dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11ea8624f674e61a98382396248c7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:52Z,use_quota=True,user_id='3f5370acf84647d3af6ef9042ba98abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:40:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Creating volume 1f400da5-9de7-46d4-b132-a5e4e8e92dd4 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:40:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:40:54 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:40:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f400da5-9de7-46d4-b132-a5e4e8e92dd4 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1bd6a12-4f94-4ed1-b6ba-95267bc4df2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98222128-f4e9-4e1f-9610-07ee85a6e47d', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:54 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f400da5-9de7-46d4-b132-a5e4e8e92dd4 1073741824 Jul 10 00:40:54 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db48618a-e639-4484-91aa-245ba6145e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:54 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Volume volume-98222128-f4e9-4e1f-9610-07ee85a6e47d (98222128-f4e9-4e1f-9610-07ee85a6e47d): created successfully Jul 10 00:40:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db48618a-e639-4484-91aa-245ba6145e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Flow 'volume_create_manager' (453ff5fe-5210-4c92-9aa8-62f93b70b16c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:54 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-55328005-8343-488a-be89-d145831179ab tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Created volume successfully. Jul 10 00:40:55 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f400da5-9de7-46d4-b132-a5e4e8e92dd4 1073741824" returned: 0 in 0.898s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f400da5-9de7-46d4-b132-a5e4e8e92dd4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:55 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f400da5-9de7-46d4-b132-a5e4e8e92dd4 Jul 10 00:40:55 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:56 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f400da5-9de7-46d4-b132-a5e4e8e92dd4" returned: 0 in 0.732s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:40:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-232042144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49489ad9-6e89-4e62-8645-7b9bda63f6d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11ea8624f674e61a98382396248c7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:52Z,use_quota=True,user_id='3f5370acf84647d3af6ef9042ba98abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:40:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Creating volume 49489ad9-6e89-4e62-8645-7b9bda63f6d9 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:40:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:40:56 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:40:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-49489ad9-6e89-4e62-8645-7b9bda63f6d9 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01eba406-ae89-41fc-b68d-4c8332766416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f400da5-9de7-46d4-b132-a5e4e8e92dd4', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:56 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-49489ad9-6e89-4e62-8645-7b9bda63f6d9 1073741824 Jul 10 00:40:56 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48600369-3fe4-4f75-af00-83561f09d875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:56 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Volume volume-1f400da5-9de7-46d4-b132-a5e4e8e92dd4 (1f400da5-9de7-46d4-b132-a5e4e8e92dd4): created successfully Jul 10 00:40:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48600369-3fe4-4f75-af00-83561f09d875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Flow 'volume_create_manager' (ffdd8d71-8579-453a-ac26-9aab2bf8996c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:56 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-a7175ae8-9e2c-4ab0-aede-aa161340f7d8 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Created volume successfully. Jul 10 00:40:57 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-49489ad9-6e89-4e62-8645-7b9bda63f6d9 1073741824" returned: 0 in 0.850s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-49489ad9-6e89-4e62-8645-7b9bda63f6d9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:57 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-49489ad9-6e89-4e62-8645-7b9bda63f6d9 Jul 10 00:40:57 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:58 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-49489ad9-6e89-4e62-8645-7b9bda63f6d9" returned: 0 in 0.696s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:40:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.196s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-402408851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75fb5ade-1d00-487e-8469-8986254d3cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11ea8624f674e61a98382396248c7ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:40:53Z,use_quota=True,user_id='3f5370acf84647d3af6ef9042ba98abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:40:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Creating volume 75fb5ade-1d00-487e-8469-8986254d3cc1 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:40:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:40:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:40:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:40:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:40:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:40:58 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:40:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-75fb5ade-1d00-487e-8469-8986254d3cc1 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:58 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-75fb5ade-1d00-487e-8469-8986254d3cc1 1073741824 Jul 10 00:40:58 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:58 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66990367-8ab0-4a7e-99d8-8f00cce9f430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49489ad9-6e89-4e62-8645-7b9bda63f6d9', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:58 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e6cd5c-d818-489c-babe-8f55a6c003f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:58 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Volume volume-49489ad9-6e89-4e62-8645-7b9bda63f6d9 (49489ad9-6e89-4e62-8645-7b9bda63f6d9): created successfully Jul 10 00:40:58 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e6cd5c-d818-489c-babe-8f55a6c003f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:58 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Flow 'volume_create_manager' (42c1901e-d2ba-4fe6-82c1-16b4aeab63f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:58 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-a0027846-77e1-4407-b8bd-5dbf33895aad tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Created volume successfully. Jul 10 00:40:58 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-75fb5ade-1d00-487e-8469-8986254d3cc1 1073741824" returned: 0 in 0.848s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-75fb5ade-1d00-487e-8469-8986254d3cc1 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:40:58 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-75fb5ade-1d00-487e-8469-8986254d3cc1 Jul 10 00:40:58 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:40:59 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Jul 10 00:40:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-75fb5ade-1d00-487e-8469-8986254d3cc1" returned: 0 in 0.693s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:40:59 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:40:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:40:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4013da64-2606-43b3-9d49-65f2ac11e4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75fb5ade-1d00-487e-8469-8986254d3cc1', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af89b6e-66c6-44ba-9f52-0f25991140f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:40:59 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Volume volume-75fb5ade-1d00-487e-8469-8986254d3cc1 (75fb5ade-1d00-487e-8469-8986254d3cc1): created successfully Jul 10 00:40:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af89b6e-66c6-44ba-9f52-0f25991140f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:40:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Flow 'volume_create_manager' (837610c4-e016-4608-8279-d43fd0aff026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:40:59 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-cae28d63-2062-4f41-baa1-c741b90d1197 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Created volume successfully. Jul 10 00:41:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-149910a2-8753-493e-8a81-a147ac30f32b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "cinder-75fb5ade-1d00-487e-8469-8986254d3cc1-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-149910a2-8753-493e-8a81-a147ac30f32b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "cinder-75fb5ade-1d00-487e-8469-8986254d3cc1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-149910a2-8753-493e-8a81-a147ac30f32b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "cinder-quobyte-75fb5ade-1d00-487e-8469-8986254d3cc1" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-149910a2-8753-493e-8a81-a147ac30f32b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "cinder-quobyte-75fb5ade-1d00-487e-8469-8986254d3cc1" acquired by "delete_volume" :: waited 0.014s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:00 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfda79d-4341-4937-9ae0-287f6f2c296c]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-149910a2-8753-493e-8a81-a147ac30f32b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-75fb5ade-1d00-487e-8469-8986254d3cc1 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:00 devstack sudo[104542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-75fb5ade-1d00-487e-8469-8986254d3cc1 Jul 10 00:41:00 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:01 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-149910a2-8753-493e-8a81-a147ac30f32b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-75fb5ade-1d00-487e-8469-8986254d3cc1" returned: 0 in 0.883s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-149910a2-8753-493e-8a81-a147ac30f32b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-75fb5ade-1d00-487e-8469-8986254d3cc1 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:01 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-75fb5ade-1d00-487e-8469-8986254d3cc1 Jul 10 00:41:01 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:01 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-149910a2-8753-493e-8a81-a147ac30f32b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-75fb5ade-1d00-487e-8469-8986254d3cc1" returned: 0 in 0.634s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:01 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-149910a2-8753-493e-8a81-a147ac30f32b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "cinder-quobyte-75fb5ade-1d00-487e-8469-8986254d3cc1" released by "delete_volume" :: held 1.561s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:02 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-149910a2-8753-493e-8a81-a147ac30f32b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Created reservations ['940b724c-36c9-4466-a092-2d0d3b4a9c9f', '5e077ccb-849c-4f3a-8ff5-d7f2c09f2dc7', '039b3547-5e8b-41ec-bece-608bb8057e17', '49808194-8a10-4cee-8c58-09cadcea2a33'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:41:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-149910a2-8753-493e-8a81-a147ac30f32b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-149910a2-8753-493e-8a81-a147ac30f32b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-149910a2-8753-493e-8a81-a147ac30f32b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-149910a2-8753-493e-8a81-a147ac30f32b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-149910a2-8753-493e-8a81-a147ac30f32b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-149910a2-8753-493e-8a81-a147ac30f32b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:02 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:41:02 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d63da0de-f462-406a-8150-3505fe4c219e tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "cinder-49489ad9-6e89-4e62-8645-7b9bda63f6d9-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d63da0de-f462-406a-8150-3505fe4c219e tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "cinder-49489ad9-6e89-4e62-8645-7b9bda63f6d9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d63da0de-f462-406a-8150-3505fe4c219e tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "cinder-quobyte-49489ad9-6e89-4e62-8645-7b9bda63f6d9" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d63da0de-f462-406a-8150-3505fe4c219e tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "cinder-quobyte-49489ad9-6e89-4e62-8645-7b9bda63f6d9" acquired by "delete_volume" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:02 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[040a072e-e84b-48e1-bf32-e2815782d8c2]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d63da0de-f462-406a-8150-3505fe4c219e tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-49489ad9-6e89-4e62-8645-7b9bda63f6d9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:02 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-149910a2-8753-493e-8a81-a147ac30f32b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.676s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:02 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-149910a2-8753-493e-8a81-a147ac30f32b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:41:02 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-149910a2-8753-493e-8a81-a147ac30f32b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Deleted volume successfully. Jul 10 00:41:02 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-49489ad9-6e89-4e62-8645-7b9bda63f6d9 Jul 10 00:41:02 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-149910a2-8753-493e-8a81-a147ac30f32b tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "cinder-75fb5ade-1d00-487e-8469-8986254d3cc1-delete_volume" released by "delete_volume" :: held 2.488s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:03 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d63da0de-f462-406a-8150-3505fe4c219e tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-49489ad9-6e89-4e62-8645-7b9bda63f6d9" returned: 0 in 0.902s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d63da0de-f462-406a-8150-3505fe4c219e tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-49489ad9-6e89-4e62-8645-7b9bda63f6d9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:03 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-49489ad9-6e89-4e62-8645-7b9bda63f6d9 Jul 10 00:41:03 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:04 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d63da0de-f462-406a-8150-3505fe4c219e tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-49489ad9-6e89-4e62-8645-7b9bda63f6d9" returned: 0 in 0.779s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d63da0de-f462-406a-8150-3505fe4c219e tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "cinder-quobyte-49489ad9-6e89-4e62-8645-7b9bda63f6d9" released by "delete_volume" :: held 1.729s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:04 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=46,cinder:UPDATE=53,cinder:INSERT=9,cinder:DELETE=5 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:41:04 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=51,cinder:UPDATE=55,cinder:INSERT=13,cinder:DELETE=5 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:41:04 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-d63da0de-f462-406a-8150-3505fe4c219e tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Created reservations ['9d44410b-c3f1-4b9f-b310-6e72cdc86e62', '6c82884c-ce3a-4f7b-bbe2-a1883262ab31', '6ffb5fb2-e2a4-4bc0-bd58-6fb01ffa3100', '33ee89ed-e872-4f66-9add-808d8677df8e'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:41:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d63da0de-f462-406a-8150-3505fe4c219e tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d63da0de-f462-406a-8150-3505fe4c219e tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:04 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d63da0de-f462-406a-8150-3505fe4c219e tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:04 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d63da0de-f462-406a-8150-3505fe4c219e tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d63da0de-f462-406a-8150-3505fe4c219e tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d63da0de-f462-406a-8150-3505fe4c219e tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:04 devstack sudo[104561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:41:04 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-71bf6787-1afe-4867-8c1b-392e6e95b8d5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "cinder-1f400da5-9de7-46d4-b132-a5e4e8e92dd4-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-71bf6787-1afe-4867-8c1b-392e6e95b8d5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "cinder-1f400da5-9de7-46d4-b132-a5e4e8e92dd4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-71bf6787-1afe-4867-8c1b-392e6e95b8d5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "cinder-quobyte-1f400da5-9de7-46d4-b132-a5e4e8e92dd4" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-71bf6787-1afe-4867-8c1b-392e6e95b8d5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "cinder-quobyte-1f400da5-9de7-46d4-b132-a5e4e8e92dd4" acquired by "delete_volume" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:05 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab35001-2967-477b-ba44-f22dd6bdf97e]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-71bf6787-1afe-4867-8c1b-392e6e95b8d5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f400da5-9de7-46d4-b132-a5e4e8e92dd4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:05 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f400da5-9de7-46d4-b132-a5e4e8e92dd4 Jul 10 00:41:05 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:05 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d63da0de-f462-406a-8150-3505fe4c219e tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.774s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:05 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-d63da0de-f462-406a-8150-3505fe4c219e tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:41:05 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-d63da0de-f462-406a-8150-3505fe4c219e tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Deleted volume successfully. Jul 10 00:41:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d63da0de-f462-406a-8150-3505fe4c219e tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "cinder-49489ad9-6e89-4e62-8645-7b9bda63f6d9-delete_volume" released by "delete_volume" :: held 2.756s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:05 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-71bf6787-1afe-4867-8c1b-392e6e95b8d5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f400da5-9de7-46d4-b132-a5e4e8e92dd4" returned: 0 in 0.936s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-71bf6787-1afe-4867-8c1b-392e6e95b8d5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f400da5-9de7-46d4-b132-a5e4e8e92dd4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:05 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f400da5-9de7-46d4-b132-a5e4e8e92dd4 Jul 10 00:41:05 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:06 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-71bf6787-1afe-4867-8c1b-392e6e95b8d5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1f400da5-9de7-46d4-b132-a5e4e8e92dd4" returned: 0 in 0.709s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:06 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-71bf6787-1afe-4867-8c1b-392e6e95b8d5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "cinder-quobyte-1f400da5-9de7-46d4-b132-a5e4e8e92dd4" released by "delete_volume" :: held 1.722s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:06 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-71bf6787-1afe-4867-8c1b-392e6e95b8d5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Created reservations ['9f1a97d1-30db-4110-8e5d-b0742170741f', 'bc03b7e8-55cc-4414-a6ff-93f68edf918d', '3d508d34-ed72-4608-95b1-f5c6092ed5fe', 'e515364b-0acc-4eb4-a89d-72d5609d3ee3'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:41:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-71bf6787-1afe-4867-8c1b-392e6e95b8d5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-71bf6787-1afe-4867-8c1b-392e6e95b8d5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:06 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-71bf6787-1afe-4867-8c1b-392e6e95b8d5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:06 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-71bf6787-1afe-4867-8c1b-392e6e95b8d5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-71bf6787-1afe-4867-8c1b-392e6e95b8d5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-71bf6787-1afe-4867-8c1b-392e6e95b8d5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:06 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:41:06 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-0ad48549-759d-4cb8-b2a9-9ba859afa1e9 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "cinder-98222128-f4e9-4e1f-9610-07ee85a6e47d-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-0ad48549-759d-4cb8-b2a9-9ba859afa1e9 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "cinder-98222128-f4e9-4e1f-9610-07ee85a6e47d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-0ad48549-759d-4cb8-b2a9-9ba859afa1e9 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "cinder-quobyte-98222128-f4e9-4e1f-9610-07ee85a6e47d" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-0ad48549-759d-4cb8-b2a9-9ba859afa1e9 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "cinder-quobyte-98222128-f4e9-4e1f-9610-07ee85a6e47d" acquired by "delete_volume" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:07 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[705b3d4e-16e4-4302-bb8d-d3b1246b8a59]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0ad48549-759d-4cb8-b2a9-9ba859afa1e9 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-98222128-f4e9-4e1f-9610-07ee85a6e47d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:07 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-98222128-f4e9-4e1f-9610-07ee85a6e47d Jul 10 00:41:07 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:07 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-71bf6787-1afe-4867-8c1b-392e6e95b8d5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.731s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:07 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-71bf6787-1afe-4867-8c1b-392e6e95b8d5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:41:07 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-71bf6787-1afe-4867-8c1b-392e6e95b8d5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Deleted volume successfully. Jul 10 00:41:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-71bf6787-1afe-4867-8c1b-392e6e95b8d5 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "cinder-1f400da5-9de7-46d4-b132-a5e4e8e92dd4-delete_volume" released by "delete_volume" :: held 2.702s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:08 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0ad48549-759d-4cb8-b2a9-9ba859afa1e9 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-98222128-f4e9-4e1f-9610-07ee85a6e47d" returned: 0 in 0.892s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0ad48549-759d-4cb8-b2a9-9ba859afa1e9 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-98222128-f4e9-4e1f-9610-07ee85a6e47d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:08 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-98222128-f4e9-4e1f-9610-07ee85a6e47d Jul 10 00:41:08 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:08 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0ad48549-759d-4cb8-b2a9-9ba859afa1e9 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-98222128-f4e9-4e1f-9610-07ee85a6e47d" returned: 0 in 0.660s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-0ad48549-759d-4cb8-b2a9-9ba859afa1e9 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "cinder-quobyte-98222128-f4e9-4e1f-9610-07ee85a6e47d" released by "delete_volume" :: held 1.599s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:08 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-0ad48549-759d-4cb8-b2a9-9ba859afa1e9 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Created reservations ['7f287134-9de7-425b-b201-d7224a3c07f4', 'c2842f82-9637-434c-8df8-f398f6e3dba5', '3b17d73c-7574-4555-99b6-dc9aa5533df9', 'c8785d45-927b-4750-bd73-d09c5523231f'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:41:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0ad48549-759d-4cb8-b2a9-9ba859afa1e9 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0ad48549-759d-4cb8-b2a9-9ba859afa1e9 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0ad48549-759d-4cb8-b2a9-9ba859afa1e9 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0ad48549-759d-4cb8-b2a9-9ba859afa1e9 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0ad48549-759d-4cb8-b2a9-9ba859afa1e9 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0ad48549-759d-4cb8-b2a9-9ba859afa1e9 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:08 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:41:08 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:09 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7a9c9786-f7e6-4443-a992-79fb86e5b56a tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "cinder-59b4502a-565e-4b64-86bd-9bc8d9aa8ef1-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:09 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7a9c9786-f7e6-4443-a992-79fb86e5b56a tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "cinder-59b4502a-565e-4b64-86bd-9bc8d9aa8ef1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:09 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7a9c9786-f7e6-4443-a992-79fb86e5b56a tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "cinder-quobyte-59b4502a-565e-4b64-86bd-9bc8d9aa8ef1" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:09 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7a9c9786-f7e6-4443-a992-79fb86e5b56a tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "cinder-quobyte-59b4502a-565e-4b64-86bd-9bc8d9aa8ef1" acquired by "delete_volume" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:09 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f43632-94ac-4a5d-9ce5-378d32a244d9]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7a9c9786-f7e6-4443-a992-79fb86e5b56a tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b4502a-565e-4b64-86bd-9bc8d9aa8ef1 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:09 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0ad48549-759d-4cb8-b2a9-9ba859afa1e9 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.690s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:09 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-0ad48549-759d-4cb8-b2a9-9ba859afa1e9 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:41:09 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b4502a-565e-4b64-86bd-9bc8d9aa8ef1 Jul 10 00:41:09 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:09 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-0ad48549-759d-4cb8-b2a9-9ba859afa1e9 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Deleted volume successfully. Jul 10 00:41:09 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-0ad48549-759d-4cb8-b2a9-9ba859afa1e9 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "cinder-98222128-f4e9-4e1f-9610-07ee85a6e47d-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:10 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7a9c9786-f7e6-4443-a992-79fb86e5b56a tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b4502a-565e-4b64-86bd-9bc8d9aa8ef1" returned: 0 in 0.779s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7a9c9786-f7e6-4443-a992-79fb86e5b56a tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b4502a-565e-4b64-86bd-9bc8d9aa8ef1 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:10 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b4502a-565e-4b64-86bd-9bc8d9aa8ef1 Jul 10 00:41:10 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:11 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7a9c9786-f7e6-4443-a992-79fb86e5b56a tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-59b4502a-565e-4b64-86bd-9bc8d9aa8ef1" returned: 0 in 0.801s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7a9c9786-f7e6-4443-a992-79fb86e5b56a tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "cinder-quobyte-59b4502a-565e-4b64-86bd-9bc8d9aa8ef1" released by "delete_volume" :: held 1.634s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:11 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-7a9c9786-f7e6-4443-a992-79fb86e5b56a tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Created reservations ['11ce9c96-a2cc-4a36-aee3-88dade50354d', '0fd5815a-e244-4e32-9568-f0546960b375', 'd755be2b-6650-4028-b4d8-4237c6708960', '87ad310c-3580-440d-88c0-096d3c82524c'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:41:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7a9c9786-f7e6-4443-a992-79fb86e5b56a tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7a9c9786-f7e6-4443-a992-79fb86e5b56a tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7a9c9786-f7e6-4443-a992-79fb86e5b56a tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7a9c9786-f7e6-4443-a992-79fb86e5b56a tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7a9c9786-f7e6-4443-a992-79fb86e5b56a tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7a9c9786-f7e6-4443-a992-79fb86e5b56a tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:11 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:41:11 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-46242e6e-24e7-4eb3-b9cf-cd7d99e33412 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "cinder-95b69b38-8e54-454a-9a12-df266dbf6ade-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-46242e6e-24e7-4eb3-b9cf-cd7d99e33412 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "cinder-95b69b38-8e54-454a-9a12-df266dbf6ade-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-46242e6e-24e7-4eb3-b9cf-cd7d99e33412 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "cinder-quobyte-95b69b38-8e54-454a-9a12-df266dbf6ade" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-46242e6e-24e7-4eb3-b9cf-cd7d99e33412 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "cinder-quobyte-95b69b38-8e54-454a-9a12-df266dbf6ade" acquired by "delete_volume" :: waited 0.020s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:11 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[259ff049-2375-41a2-8e85-54d4a055bf83]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-46242e6e-24e7-4eb3-b9cf-cd7d99e33412 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-95b69b38-8e54-454a-9a12-df266dbf6ade {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:11 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-95b69b38-8e54-454a-9a12-df266dbf6ade Jul 10 00:41:11 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:12 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7a9c9786-f7e6-4443-a992-79fb86e5b56a tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.734s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:12 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-7a9c9786-f7e6-4443-a992-79fb86e5b56a tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:41:12 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-7a9c9786-f7e6-4443-a992-79fb86e5b56a tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Deleted volume successfully. Jul 10 00:41:12 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7a9c9786-f7e6-4443-a992-79fb86e5b56a tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "cinder-59b4502a-565e-4b64-86bd-9bc8d9aa8ef1-delete_volume" released by "delete_volume" :: held 2.599s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:12 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-46242e6e-24e7-4eb3-b9cf-cd7d99e33412 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-95b69b38-8e54-454a-9a12-df266dbf6ade" returned: 0 in 0.828s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-46242e6e-24e7-4eb3-b9cf-cd7d99e33412 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-95b69b38-8e54-454a-9a12-df266dbf6ade {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:12 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-95b69b38-8e54-454a-9a12-df266dbf6ade Jul 10 00:41:12 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:13 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-46242e6e-24e7-4eb3-b9cf-cd7d99e33412 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-95b69b38-8e54-454a-9a12-df266dbf6ade" returned: 0 in 0.657s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:13 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-46242e6e-24e7-4eb3-b9cf-cd7d99e33412 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "cinder-quobyte-95b69b38-8e54-454a-9a12-df266dbf6ade" released by "delete_volume" :: held 1.540s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:13 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-46242e6e-24e7-4eb3-b9cf-cd7d99e33412 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Created reservations ['79a3c817-5fe8-4ccb-8bc2-e0bf099d222f', '09dcce51-50b1-4de6-a148-1cc11fffdeb0', 'e0597ab5-4960-4b72-b8f0-2715918c0047', '7cca17a8-5e2d-4378-a64b-dc88643d8dc3'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:41:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-46242e6e-24e7-4eb3-b9cf-cd7d99e33412 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-46242e6e-24e7-4eb3-b9cf-cd7d99e33412 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-46242e6e-24e7-4eb3-b9cf-cd7d99e33412 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-46242e6e-24e7-4eb3-b9cf-cd7d99e33412 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-46242e6e-24e7-4eb3-b9cf-cd7d99e33412 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-46242e6e-24e7-4eb3-b9cf-cd7d99e33412 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:13 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:41:13 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:14 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-46242e6e-24e7-4eb3-b9cf-cd7d99e33412 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.815s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:14 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-46242e6e-24e7-4eb3-b9cf-cd7d99e33412 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:41:14 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-46242e6e-24e7-4eb3-b9cf-cd7d99e33412 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Deleted volume successfully. Jul 10 00:41:14 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-46242e6e-24e7-4eb3-b9cf-cd7d99e33412 tempest-CreateVolumesFromSourceVolumeTest-706140167 None] Lock "cinder-95b69b38-8e54-454a-9a12-df266dbf6ade-delete_volume" released by "delete_volume" :: held 2.611s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:17 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:41:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Flow 'volume_create_manager' (d68183b0-eea7-4627-ac84-2e2ae8cc12c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:41:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd38641-f65d-43c4-83ff-780945e69f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd38641-f65d-43c4-83ff-780945e69f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1319541457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=423a27e5-0fb8-4920-81fc-99b032d5c0ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46cb81eee4bb4ae68f65767a888f2d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:41:18Z,use_quota=True,user_id='265cafb541c64d7caa9bb085babb74bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e10ad554-7367-4871-a05f-5b15090cd8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e10ad554-7367-4871-a05f-5b15090cd8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61458568-b48d-4ea5-894d-478a76476287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61458568-b48d-4ea5-894d-478a76476287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '423a27e5-0fb8-4920-81fc-99b032d5c0ca', 'volume_name': 'volume-423a27e5-0fb8-4920-81fc-99b032d5c0ca', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47dacc54-8bcc-4891-8aae-ce8703af968a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47dacc54-8bcc-4891-8aae-ce8703af968a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7404a51b-7853-4730-aaec-19382ae224d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:17 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Volume 423a27e5-0fb8-4920-81fc-99b032d5c0ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-423a27e5-0fb8-4920-81fc-99b032d5c0ca', 'volume_size': 1} Jul 10 00:41:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1319541457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=423a27e5-0fb8-4920-81fc-99b032d5c0ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46cb81eee4bb4ae68f65767a888f2d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:41:18Z,use_quota=True,user_id='265cafb541c64d7caa9bb085babb74bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:41:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Creating volume 423a27e5-0fb8-4920-81fc-99b032d5c0ca {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:41:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:41:17 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:41:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-423a27e5-0fb8-4920-81fc-99b032d5c0ca 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:17 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-423a27e5-0fb8-4920-81fc-99b032d5c0ca 1073741824 Jul 10 00:41:17 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:18 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-423a27e5-0fb8-4920-81fc-99b032d5c0ca 1073741824" returned: 0 in 0.921s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-423a27e5-0fb8-4920-81fc-99b032d5c0ca {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:18 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-423a27e5-0fb8-4920-81fc-99b032d5c0ca Jul 10 00:41:18 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:19 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-423a27e5-0fb8-4920-81fc-99b032d5c0ca" returned: 0 in 0.653s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7404a51b-7853-4730-aaec-19382ae224d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-423a27e5-0fb8-4920-81fc-99b032d5c0ca', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87fc0482-9341-4afd-9be6-e7af746d1db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:19 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Volume volume-423a27e5-0fb8-4920-81fc-99b032d5c0ca (423a27e5-0fb8-4920-81fc-99b032d5c0ca): created successfully Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87fc0482-9341-4afd-9be6-e7af746d1db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Flow 'volume_create_manager' (d68183b0-eea7-4627-ac84-2e2ae8cc12c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:41:19 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-3070b3e5-3647-443a-b38c-f175a1f3edfa tempest-ProjectReaderTests-1328838867 None] Created volume successfully. Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Flow 'volume_create_manager' (fd6fa508-b8ab-49db-b7d8-238626018a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe80c0a8-ca7c-4c7d-9dfb-c43883d1d000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe80c0a8-ca7c-4c7d-9dfb-c43883d1d000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1896616338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=566336b2-112f-4be9-bd3c-d6ee05c2384e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c01d3e73fef4875a1e620c0b04604f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:41:20Z,use_quota=True,user_id='778c18dca7f34ce18d133ed79e6064bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c9c53f5-7820-4706-acf7-dadd965cd6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c9c53f5-7820-4706-acf7-dadd965cd6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e118045b-d3da-419b-9491-ce8ebecdf954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e118045b-d3da-419b-9491-ce8ebecdf954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '566336b2-112f-4be9-bd3c-d6ee05c2384e', 'volume_name': 'volume-566336b2-112f-4be9-bd3c-d6ee05c2384e', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392515ee-4bd6-400b-b772-f55954e3c814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392515ee-4bd6-400b-b772-f55954e3c814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8707cd2-fc1b-4eb0-989c-a22d068ea328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:19 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Volume 566336b2-112f-4be9-bd3c-d6ee05c2384e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-566336b2-112f-4be9-bd3c-d6ee05c2384e', 'volume_size': 1} Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1896616338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=566336b2-112f-4be9-bd3c-d6ee05c2384e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c01d3e73fef4875a1e620c0b04604f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:41:20Z,use_quota=True,user_id='778c18dca7f34ce18d133ed79e6064bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Creating volume 566336b2-112f-4be9-bd3c-d6ee05c2384e {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:41:19 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:19 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e 1073741824 Jul 10 00:41:19 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:19 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7e640ce0-6b09-4130-b14c-fe7ade806fef tempest-ProjectReaderTests-1328838867 None] Acquiring lock "cinder-423a27e5-0fb8-4920-81fc-99b032d5c0ca-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7e640ce0-6b09-4130-b14c-fe7ade806fef tempest-ProjectReaderTests-1328838867 None] Lock "cinder-423a27e5-0fb8-4920-81fc-99b032d5c0ca-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7e640ce0-6b09-4130-b14c-fe7ade806fef tempest-ProjectReaderTests-1328838867 None] Acquiring lock "cinder-quobyte-423a27e5-0fb8-4920-81fc-99b032d5c0ca" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7e640ce0-6b09-4130-b14c-fe7ade806fef tempest-ProjectReaderTests-1328838867 None] Lock "cinder-quobyte-423a27e5-0fb8-4920-81fc-99b032d5c0ca" acquired by "delete_volume" :: waited 0.022s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:20 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[998dccda-d0cf-4c0d-9dba-6661c47c4a2f]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7e640ce0-6b09-4130-b14c-fe7ade806fef tempest-ProjectReaderTests-1328838867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-423a27e5-0fb8-4920-81fc-99b032d5c0ca {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:20 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-423a27e5-0fb8-4920-81fc-99b032d5c0ca Jul 10 00:41:20 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:20 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e 1073741824" returned: 0 in 0.916s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:20 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e Jul 10 00:41:20 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:20 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7e640ce0-6b09-4130-b14c-fe7ade806fef tempest-ProjectReaderTests-1328838867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-423a27e5-0fb8-4920-81fc-99b032d5c0ca" returned: 0 in 0.807s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7e640ce0-6b09-4130-b14c-fe7ade806fef tempest-ProjectReaderTests-1328838867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-423a27e5-0fb8-4920-81fc-99b032d5c0ca {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:20 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-423a27e5-0fb8-4920-81fc-99b032d5c0ca Jul 10 00:41:20 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:21 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e" returned: 0 in 0.675s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:21 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:41:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:21 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8707cd2-fc1b-4eb0-989c-a22d068ea328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-566336b2-112f-4be9-bd3c-d6ee05c2384e', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:21 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45fd591b-7045-4837-b392-02be65468be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:21 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Volume volume-566336b2-112f-4be9-bd3c-d6ee05c2384e (566336b2-112f-4be9-bd3c-d6ee05c2384e): created successfully Jul 10 00:41:21 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45fd591b-7045-4837-b392-02be65468be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:21 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Flow 'volume_create_manager' (fd6fa508-b8ab-49db-b7d8-238626018a1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:41:21 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-a511a1c9-6d15-4d6a-91ac-f5ecdef352ad tempest-TestStampPattern-377134180 None] Created volume successfully. Jul 10 00:41:21 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7e640ce0-6b09-4130-b14c-fe7ade806fef tempest-ProjectReaderTests-1328838867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-423a27e5-0fb8-4920-81fc-99b032d5c0ca" returned: 0 in 0.693s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:21 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7e640ce0-6b09-4130-b14c-fe7ade806fef tempest-ProjectReaderTests-1328838867 None] Lock "cinder-quobyte-423a27e5-0fb8-4920-81fc-99b032d5c0ca" released by "delete_volume" :: held 1.554s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:21 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-7e640ce0-6b09-4130-b14c-fe7ade806fef tempest-ProjectReaderTests-1328838867 None] Created reservations ['3ab380e3-6037-47b7-808f-8c306ef36c88', 'cb4aa9d4-a85d-479a-bfc2-cf54c0cfbef8', 'd8e522a5-6168-429a-ad34-c01226bf683e', '585edbf0-e9cb-4207-88db-17ba4e869fb1'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:41:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7e640ce0-6b09-4130-b14c-fe7ade806fef tempest-ProjectReaderTests-1328838867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7e640ce0-6b09-4130-b14c-fe7ade806fef tempest-ProjectReaderTests-1328838867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:21 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7e640ce0-6b09-4130-b14c-fe7ade806fef tempest-ProjectReaderTests-1328838867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:21 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7e640ce0-6b09-4130-b14c-fe7ade806fef tempest-ProjectReaderTests-1328838867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7e640ce0-6b09-4130-b14c-fe7ade806fef tempest-ProjectReaderTests-1328838867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7e640ce0-6b09-4130-b14c-fe7ade806fef tempest-ProjectReaderTests-1328838867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:21 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:41:21 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:22 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7e640ce0-6b09-4130-b14c-fe7ade806fef tempest-ProjectReaderTests-1328838867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.666s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:22 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-7e640ce0-6b09-4130-b14c-fe7ade806fef tempest-ProjectReaderTests-1328838867 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:41:22 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-7e640ce0-6b09-4130-b14c-fe7ade806fef tempest-ProjectReaderTests-1328838867 None] Deleted volume successfully. Jul 10 00:41:22 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7e640ce0-6b09-4130-b14c-fe7ade806fef tempest-ProjectReaderTests-1328838867 None] Lock "cinder-423a27e5-0fb8-4920-81fc-99b032d5c0ca-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:22 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:41:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Flow 'volume_create_manager' (ce5a74a6-bf98-4e17-a698-02e7295e7602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:41:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a5762d-46c3-41ee-9f56-35887b7e17ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a5762d-46c3-41ee-9f56-35887b7e17ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1168906923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b38c074a-68d8-4ba0-82db-087ce38a2e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46cb81eee4bb4ae68f65767a888f2d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:41:23Z,use_quota=True,user_id='265cafb541c64d7caa9bb085babb74bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7447cc-9a01-405d-8d9b-1d2410fab9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7447cc-9a01-405d-8d9b-1d2410fab9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d84d0b53-25ab-4dd4-8400-7920b2a524d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d84d0b53-25ab-4dd4-8400-7920b2a524d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b38c074a-68d8-4ba0-82db-087ce38a2e4f', 'volume_name': 'volume-b38c074a-68d8-4ba0-82db-087ce38a2e4f', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77984535-1183-471a-b92c-cadc9157559c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77984535-1183-471a-b92c-cadc9157559c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00cf62d1-652e-48b7-86a8-e8b7e3170dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:22 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Volume b38c074a-68d8-4ba0-82db-087ce38a2e4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b38c074a-68d8-4ba0-82db-087ce38a2e4f', 'volume_size': 1} Jul 10 00:41:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:22 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1168906923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b38c074a-68d8-4ba0-82db-087ce38a2e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46cb81eee4bb4ae68f65767a888f2d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:41:23Z,use_quota=True,user_id='265cafb541c64d7caa9bb085babb74bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:41:22 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Creating volume b38c074a-68d8-4ba0-82db-087ce38a2e4f {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:41:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:22 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:22 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:22 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:41:22 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:41:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b38c074a-68d8-4ba0-82db-087ce38a2e4f 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:22 devstack sudo[104646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b38c074a-68d8-4ba0-82db-087ce38a2e4f 1073741824 Jul 10 00:41:22 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:23 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b38c074a-68d8-4ba0-82db-087ce38a2e4f 1073741824" returned: 0 in 0.783s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b38c074a-68d8-4ba0-82db-087ce38a2e4f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:23 devstack sudo[104652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b38c074a-68d8-4ba0-82db-087ce38a2e4f Jul 10 00:41:23 devstack sudo[104652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:24 devstack sudo[104652]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b38c074a-68d8-4ba0-82db-087ce38a2e4f" returned: 0 in 0.616s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:41:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00cf62d1-652e-48b7-86a8-e8b7e3170dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b38c074a-68d8-4ba0-82db-087ce38a2e4f', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da629ef6-b76b-4140-98d4-4b4172bd473b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:24 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Volume volume-b38c074a-68d8-4ba0-82db-087ce38a2e4f (b38c074a-68d8-4ba0-82db-087ce38a2e4f): created successfully Jul 10 00:41:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da629ef6-b76b-4140-98d4-4b4172bd473b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:24 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Flow 'volume_create_manager' (ce5a74a6-bf98-4e17-a698-02e7295e7602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:41:24 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-2b4c82fd-f4a0-4ebf-a98f-142165ca2b33 tempest-ProjectReaderTests-1328838867 None] Created volume successfully. Jul 10 00:41:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b255a477-3bc0-4a5c-b4d7-ad5d500ee4af tempest-ProjectReaderTests-1328838867 None] Acquiring lock "cinder-b38c074a-68d8-4ba0-82db-087ce38a2e4f-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b255a477-3bc0-4a5c-b4d7-ad5d500ee4af tempest-ProjectReaderTests-1328838867 None] Lock "cinder-b38c074a-68d8-4ba0-82db-087ce38a2e4f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b255a477-3bc0-4a5c-b4d7-ad5d500ee4af tempest-ProjectReaderTests-1328838867 None] Acquiring lock "cinder-quobyte-b38c074a-68d8-4ba0-82db-087ce38a2e4f" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b255a477-3bc0-4a5c-b4d7-ad5d500ee4af tempest-ProjectReaderTests-1328838867 None] Lock "cinder-quobyte-b38c074a-68d8-4ba0-82db-087ce38a2e4f" acquired by "delete_volume" :: waited 0.014s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:24 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[08152134-548c-426c-9bd7-d8a27333bc40]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b255a477-3bc0-4a5c-b4d7-ad5d500ee4af tempest-ProjectReaderTests-1328838867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b38c074a-68d8-4ba0-82db-087ce38a2e4f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:24 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b38c074a-68d8-4ba0-82db-087ce38a2e4f Jul 10 00:41:24 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:25 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b255a477-3bc0-4a5c-b4d7-ad5d500ee4af tempest-ProjectReaderTests-1328838867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b38c074a-68d8-4ba0-82db-087ce38a2e4f" returned: 0 in 0.788s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b255a477-3bc0-4a5c-b4d7-ad5d500ee4af tempest-ProjectReaderTests-1328838867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b38c074a-68d8-4ba0-82db-087ce38a2e4f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:25 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b38c074a-68d8-4ba0-82db-087ce38a2e4f Jul 10 00:41:25 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:26 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b255a477-3bc0-4a5c-b4d7-ad5d500ee4af tempest-ProjectReaderTests-1328838867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b38c074a-68d8-4ba0-82db-087ce38a2e4f" returned: 0 in 0.709s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b255a477-3bc0-4a5c-b4d7-ad5d500ee4af tempest-ProjectReaderTests-1328838867 None] Lock "cinder-quobyte-b38c074a-68d8-4ba0-82db-087ce38a2e4f" released by "delete_volume" :: held 1.533s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:26 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-b255a477-3bc0-4a5c-b4d7-ad5d500ee4af tempest-ProjectReaderTests-1328838867 None] Created reservations ['f2c57acf-5b15-4968-8b34-d1d7098127ea', '2962d12f-3759-4dd3-b11e-2741bec7bca5', '3eedcc87-5b4d-44dd-97eb-be003ec8300c', 'bed30a34-64f6-40d0-a9db-7a046957091a'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:41:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b255a477-3bc0-4a5c-b4d7-ad5d500ee4af tempest-ProjectReaderTests-1328838867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b255a477-3bc0-4a5c-b4d7-ad5d500ee4af tempest-ProjectReaderTests-1328838867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b255a477-3bc0-4a5c-b4d7-ad5d500ee4af tempest-ProjectReaderTests-1328838867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b255a477-3bc0-4a5c-b4d7-ad5d500ee4af tempest-ProjectReaderTests-1328838867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b255a477-3bc0-4a5c-b4d7-ad5d500ee4af tempest-ProjectReaderTests-1328838867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b255a477-3bc0-4a5c-b4d7-ad5d500ee4af tempest-ProjectReaderTests-1328838867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:26 devstack sudo[104664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:41:26 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:27 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b255a477-3bc0-4a5c-b4d7-ad5d500ee4af tempest-ProjectReaderTests-1328838867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.713s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:27 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-b255a477-3bc0-4a5c-b4d7-ad5d500ee4af tempest-ProjectReaderTests-1328838867 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:41:27 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-b255a477-3bc0-4a5c-b4d7-ad5d500ee4af tempest-ProjectReaderTests-1328838867 None] Deleted volume successfully. Jul 10 00:41:27 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b255a477-3bc0-4a5c-b4d7-ad5d500ee4af tempest-ProjectReaderTests-1328838867 None] Lock "cinder-b38c074a-68d8-4ba0-82db-087ce38a2e4f-delete_volume" released by "delete_volume" :: held 2.458s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:41:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:31 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:41:31 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:32 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.672s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:32 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:41:32 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:41:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 29 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:41:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:41:35 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:41:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Flow 'volume_create_manager' (6ff422b9-3d56-42ea-8387-e70edb8555da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:41:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df1e4081-e641-4e0f-8f00-1266fe94b2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df1e4081-e641-4e0f-8f00-1266fe94b2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-478635264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2b5200c-e800-4ba5-bd57-a43345417f20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5224a50af043d1a1b066173add6e1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:41:36Z,use_quota=True,user_id='05ea853d83974242b5cb09737332f1c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ccb7a4d-5eae-460f-b65d-b51ad40da82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ccb7a4d-5eae-460f-b65d-b51ad40da82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eac2335-ab20-44f8-a81d-82fc14e864af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eac2335-ab20-44f8-a81d-82fc14e864af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2b5200c-e800-4ba5-bd57-a43345417f20', 'volume_name': 'volume-e2b5200c-e800-4ba5-bd57-a43345417f20', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1756099-5ada-4557-bd3c-b8321340f4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1756099-5ada-4557-bd3c-b8321340f4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7e3d9a-db6d-4889-b37b-ed6ec6a318ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:35 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Volume e2b5200c-e800-4ba5-bd57-a43345417f20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2b5200c-e800-4ba5-bd57-a43345417f20', 'volume_size': 1} Jul 10 00:41:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-478635264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2b5200c-e800-4ba5-bd57-a43345417f20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5224a50af043d1a1b066173add6e1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:41:36Z,use_quota=True,user_id='05ea853d83974242b5cb09737332f1c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:41:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Creating volume e2b5200c-e800-4ba5-bd57-a43345417f20 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:41:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:41:35 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:41:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e2b5200c-e800-4ba5-bd57-a43345417f20 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:35 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e2b5200c-e800-4ba5-bd57-a43345417f20 1073741824 Jul 10 00:41:35 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:36 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e2b5200c-e800-4ba5-bd57-a43345417f20 1073741824" returned: 0 in 0.909s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e2b5200c-e800-4ba5-bd57-a43345417f20 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:36 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e2b5200c-e800-4ba5-bd57-a43345417f20 Jul 10 00:41:36 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:37 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e2b5200c-e800-4ba5-bd57-a43345417f20" returned: 0 in 0.702s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:41:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7e3d9a-db6d-4889-b37b-ed6ec6a318ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2b5200c-e800-4ba5-bd57-a43345417f20', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f25267-04e6-44ac-8c2a-b60a5ce4064a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:37 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Volume volume-e2b5200c-e800-4ba5-bd57-a43345417f20 (e2b5200c-e800-4ba5-bd57-a43345417f20): created successfully Jul 10 00:41:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f25267-04e6-44ac-8c2a-b60a5ce4064a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Flow 'volume_create_manager' (6ff422b9-3d56-42ea-8387-e70edb8555da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:41:37 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-f2041e2a-b6db-46e0-b4ff-00805cc704c6 tempest-ProjectReaderTests-1678750332 None] Created volume successfully. Jul 10 00:41:37 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ac647373-610f-49a4-8beb-987b225e2bf0 tempest-ProjectReaderTests-1678750332 None] Acquiring lock "cinder-e2b5200c-e800-4ba5-bd57-a43345417f20-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:37 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ac647373-610f-49a4-8beb-987b225e2bf0 tempest-ProjectReaderTests-1678750332 None] Lock "cinder-e2b5200c-e800-4ba5-bd57-a43345417f20-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:37 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ac647373-610f-49a4-8beb-987b225e2bf0 tempest-ProjectReaderTests-1678750332 None] Acquiring lock "cinder-quobyte-e2b5200c-e800-4ba5-bd57-a43345417f20" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:37 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ac647373-610f-49a4-8beb-987b225e2bf0 tempest-ProjectReaderTests-1678750332 None] Lock "cinder-quobyte-e2b5200c-e800-4ba5-bd57-a43345417f20" acquired by "delete_volume" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:37 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[a754ff39-baa7-4176-851d-208f6fd743d0]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ac647373-610f-49a4-8beb-987b225e2bf0 tempest-ProjectReaderTests-1678750332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e2b5200c-e800-4ba5-bd57-a43345417f20 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:38 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e2b5200c-e800-4ba5-bd57-a43345417f20 Jul 10 00:41:38 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:38 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ac647373-610f-49a4-8beb-987b225e2bf0 tempest-ProjectReaderTests-1678750332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e2b5200c-e800-4ba5-bd57-a43345417f20" returned: 0 in 0.790s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ac647373-610f-49a4-8beb-987b225e2bf0 tempest-ProjectReaderTests-1678750332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e2b5200c-e800-4ba5-bd57-a43345417f20 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:38 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e2b5200c-e800-4ba5-bd57-a43345417f20 Jul 10 00:41:38 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:39 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ac647373-610f-49a4-8beb-987b225e2bf0 tempest-ProjectReaderTests-1678750332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e2b5200c-e800-4ba5-bd57-a43345417f20" returned: 0 in 0.655s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:39 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ac647373-610f-49a4-8beb-987b225e2bf0 tempest-ProjectReaderTests-1678750332 None] Lock "cinder-quobyte-e2b5200c-e800-4ba5-bd57-a43345417f20" released by "delete_volume" :: held 1.489s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:39 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-ac647373-610f-49a4-8beb-987b225e2bf0 tempest-ProjectReaderTests-1678750332 None] Created reservations ['28e8b5df-bbd5-4e22-8721-f63b69b3604f', '5d177f96-e6e4-4606-92b1-7fd04c147ab0', 'abd9914a-5628-4b54-a17a-5c8d68334a95', '168fead0-bce3-4fed-90c4-4f6c8501f040'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:41:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ac647373-610f-49a4-8beb-987b225e2bf0 tempest-ProjectReaderTests-1678750332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ac647373-610f-49a4-8beb-987b225e2bf0 tempest-ProjectReaderTests-1678750332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:39 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ac647373-610f-49a4-8beb-987b225e2bf0 tempest-ProjectReaderTests-1678750332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:39 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ac647373-610f-49a4-8beb-987b225e2bf0 tempest-ProjectReaderTests-1678750332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ac647373-610f-49a4-8beb-987b225e2bf0 tempest-ProjectReaderTests-1678750332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ac647373-610f-49a4-8beb-987b225e2bf0 tempest-ProjectReaderTests-1678750332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:39 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:41:39 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:40 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ac647373-610f-49a4-8beb-987b225e2bf0 tempest-ProjectReaderTests-1678750332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.628s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:40 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-ac647373-610f-49a4-8beb-987b225e2bf0 tempest-ProjectReaderTests-1678750332 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:41:40 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-ac647373-610f-49a4-8beb-987b225e2bf0 tempest-ProjectReaderTests-1678750332 None] Deleted volume successfully. Jul 10 00:41:40 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ac647373-610f-49a4-8beb-987b225e2bf0 tempest-ProjectReaderTests-1678750332 None] Lock "cinder-e2b5200c-e800-4ba5-bd57-a43345417f20-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:40 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:41:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Flow 'volume_create_manager' (ca848d8f-657a-424a-b7dc-fa2f9f8400ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:41:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d92d3a3-049a-4269-b05d-e73d45b47703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d92d3a3-049a-4269-b05d-e73d45b47703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1580354140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80174de6-1cb2-481c-b019-dc7530bed4a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5224a50af043d1a1b066173add6e1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:41:41Z,use_quota=True,user_id='05ea853d83974242b5cb09737332f1c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a99aa0bd-b4ab-45bb-b80f-e021cfd62ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a99aa0bd-b4ab-45bb-b80f-e021cfd62ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c0cff09-97dd-45d1-a4ed-cf72f399dcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c0cff09-97dd-45d1-a4ed-cf72f399dcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80174de6-1cb2-481c-b019-dc7530bed4a7', 'volume_name': 'volume-80174de6-1cb2-481c-b019-dc7530bed4a7', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fbf7ad6-0bc4-4055-93bd-f285beb79252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fbf7ad6-0bc4-4055-93bd-f285beb79252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eabef445-7e2b-4193-aec1-ed32e6312f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:40 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Volume 80174de6-1cb2-481c-b019-dc7530bed4a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80174de6-1cb2-481c-b019-dc7530bed4a7', 'volume_size': 1} Jul 10 00:41:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:41:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1580354140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80174de6-1cb2-481c-b019-dc7530bed4a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5224a50af043d1a1b066173add6e1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:41:41Z,use_quota=True,user_id='05ea853d83974242b5cb09737332f1c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:41:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Creating volume 80174de6-1cb2-481c-b019-dc7530bed4a7 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:41:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:41:40 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:41:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-80174de6-1cb2-481c-b019-dc7530bed4a7 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:40 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-80174de6-1cb2-481c-b019-dc7530bed4a7 1073741824 Jul 10 00:41:40 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:41 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-80174de6-1cb2-481c-b019-dc7530bed4a7 1073741824" returned: 0 in 0.810s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-80174de6-1cb2-481c-b019-dc7530bed4a7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:41 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-80174de6-1cb2-481c-b019-dc7530bed4a7 Jul 10 00:41:41 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:42 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-80174de6-1cb2-481c-b019-dc7530bed4a7" returned: 0 in 0.632s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:42 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:41:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eabef445-7e2b-4193-aec1-ed32e6312f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80174de6-1cb2-481c-b019-dc7530bed4a7', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df451f42-a41b-4a68-90ee-ecb97607019c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:42 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Volume volume-80174de6-1cb2-481c-b019-dc7530bed4a7 (80174de6-1cb2-481c-b019-dc7530bed4a7): created successfully Jul 10 00:41:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df451f42-a41b-4a68-90ee-ecb97607019c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:42 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Flow 'volume_create_manager' (ca848d8f-657a-424a-b7dc-fa2f9f8400ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:41:42 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-ca88c244-6b09-4bb1-811b-6e381e44efa5 tempest-ProjectReaderTests-1678750332 None] Created volume successfully. Jul 10 00:41:42 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ef79526f-4fcc-4972-8573-98a43bdce394 tempest-ProjectReaderTests-1678750332 None] Acquiring lock "cinder-80174de6-1cb2-481c-b019-dc7530bed4a7-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:42 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ef79526f-4fcc-4972-8573-98a43bdce394 tempest-ProjectReaderTests-1678750332 None] Lock "cinder-80174de6-1cb2-481c-b019-dc7530bed4a7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:42 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ef79526f-4fcc-4972-8573-98a43bdce394 tempest-ProjectReaderTests-1678750332 None] Acquiring lock "cinder-quobyte-80174de6-1cb2-481c-b019-dc7530bed4a7" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:42 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ef79526f-4fcc-4972-8573-98a43bdce394 tempest-ProjectReaderTests-1678750332 None] Lock "cinder-quobyte-80174de6-1cb2-481c-b019-dc7530bed4a7" acquired by "delete_volume" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:42 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[37544418-92d2-4675-b2cc-9bfb8a236a1c]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ef79526f-4fcc-4972-8573-98a43bdce394 tempest-ProjectReaderTests-1678750332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-80174de6-1cb2-481c-b019-dc7530bed4a7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:42 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-80174de6-1cb2-481c-b019-dc7530bed4a7 Jul 10 00:41:42 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:43 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ef79526f-4fcc-4972-8573-98a43bdce394 tempest-ProjectReaderTests-1678750332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-80174de6-1cb2-481c-b019-dc7530bed4a7" returned: 0 in 0.742s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ef79526f-4fcc-4972-8573-98a43bdce394 tempest-ProjectReaderTests-1678750332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-80174de6-1cb2-481c-b019-dc7530bed4a7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:43 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-80174de6-1cb2-481c-b019-dc7530bed4a7 Jul 10 00:41:43 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:44 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ef79526f-4fcc-4972-8573-98a43bdce394 tempest-ProjectReaderTests-1678750332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-80174de6-1cb2-481c-b019-dc7530bed4a7" returned: 0 in 0.637s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:44 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ef79526f-4fcc-4972-8573-98a43bdce394 tempest-ProjectReaderTests-1678750332 None] Lock "cinder-quobyte-80174de6-1cb2-481c-b019-dc7530bed4a7" released by "delete_volume" :: held 1.420s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:44 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-ef79526f-4fcc-4972-8573-98a43bdce394 tempest-ProjectReaderTests-1678750332 None] Created reservations ['0a5da2e1-e7b8-4d55-b833-f422e5b724ad', '74132467-de33-421e-99cb-532c04d68378', '873fed00-66b6-4150-8f28-df6632ae71d2', '3c6b3c4e-cdf2-4fc1-a327-7cf537a1e4d8'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:41:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ef79526f-4fcc-4972-8573-98a43bdce394 tempest-ProjectReaderTests-1678750332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ef79526f-4fcc-4972-8573-98a43bdce394 tempest-ProjectReaderTests-1678750332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ef79526f-4fcc-4972-8573-98a43bdce394 tempest-ProjectReaderTests-1678750332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ef79526f-4fcc-4972-8573-98a43bdce394 tempest-ProjectReaderTests-1678750332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ef79526f-4fcc-4972-8573-98a43bdce394 tempest-ProjectReaderTests-1678750332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ef79526f-4fcc-4972-8573-98a43bdce394 tempest-ProjectReaderTests-1678750332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:44 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:41:44 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:45 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ef79526f-4fcc-4972-8573-98a43bdce394 tempest-ProjectReaderTests-1678750332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.680s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:45 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-ef79526f-4fcc-4972-8573-98a43bdce394 tempest-ProjectReaderTests-1678750332 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:41:45 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-ef79526f-4fcc-4972-8573-98a43bdce394 tempest-ProjectReaderTests-1678750332 None] Deleted volume successfully. Jul 10 00:41:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-ef79526f-4fcc-4972-8573-98a43bdce394 tempest-ProjectReaderTests-1678750332 None] Lock "cinder-80174de6-1cb2-481c-b019-dc7530bed4a7-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:45 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:41:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Flow 'volume_create_manager' (a9ad9d7c-67bd-47c6-a53f-614ad4d9cf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:41:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4391c9e2-cae2-4fe9-9b9a-fadd0d2c9470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4391c9e2-cae2-4fe9-9b9a-fadd0d2c9470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-573238914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c6888b-c4dc-4bf6-801b-9aa9bb18f271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5224a50af043d1a1b066173add6e1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:41:45Z,use_quota=True,user_id='05ea853d83974242b5cb09737332f1c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e3107ff-1cbc-4c74-91ef-666dc21b7a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e3107ff-1cbc-4c74-91ef-666dc21b7a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680b205b-97b4-465d-971a-5fa00a26b5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680b205b-97b4-465d-971a-5fa00a26b5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76c6888b-c4dc-4bf6-801b-9aa9bb18f271', 'volume_name': 'volume-76c6888b-c4dc-4bf6-801b-9aa9bb18f271', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af55c66-d3d7-47b1-bf72-61441a72db45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af55c66-d3d7-47b1-bf72-61441a72db45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ec3832-622e-4073-8824-568256de116c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:45 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Volume 76c6888b-c4dc-4bf6-801b-9aa9bb18f271: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76c6888b-c4dc-4bf6-801b-9aa9bb18f271', 'volume_size': 1} Jul 10 00:41:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-573238914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c6888b-c4dc-4bf6-801b-9aa9bb18f271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5224a50af043d1a1b066173add6e1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:41:45Z,use_quota=True,user_id='05ea853d83974242b5cb09737332f1c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:41:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Creating volume 76c6888b-c4dc-4bf6-801b-9aa9bb18f271 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:41:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:41:45 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:41:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-76c6888b-c4dc-4bf6-801b-9aa9bb18f271 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:45 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-76c6888b-c4dc-4bf6-801b-9aa9bb18f271 1073741824 Jul 10 00:41:45 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:46 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-76c6888b-c4dc-4bf6-801b-9aa9bb18f271 1073741824" returned: 0 in 0.777s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-76c6888b-c4dc-4bf6-801b-9aa9bb18f271 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:46 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-76c6888b-c4dc-4bf6-801b-9aa9bb18f271 Jul 10 00:41:46 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:46 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-76c6888b-c4dc-4bf6-801b-9aa9bb18f271" returned: 0 in 0.599s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:46 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] <== create_volume: return (1421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:41:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ec3832-622e-4073-8824-568256de116c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76c6888b-c4dc-4bf6-801b-9aa9bb18f271', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (817ea844-8039-4101-9229-e1edc5b9a70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:46 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Volume volume-76c6888b-c4dc-4bf6-801b-9aa9bb18f271 (76c6888b-c4dc-4bf6-801b-9aa9bb18f271): created successfully Jul 10 00:41:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (817ea844-8039-4101-9229-e1edc5b9a70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Flow 'volume_create_manager' (a9ad9d7c-67bd-47c6-a53f-614ad4d9cf5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:41:46 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-d48c6b40-76c9-44ff-b8ed-4226a2279e10 tempest-ProjectReaderTests-1678750332 None] Created volume successfully. Jul 10 00:41:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-4367111f-6864-4e9b-99e5-ce35676e8e0f tempest-ProjectReaderTests-1678750332 None] Acquiring lock "cinder-76c6888b-c4dc-4bf6-801b-9aa9bb18f271-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-4367111f-6864-4e9b-99e5-ce35676e8e0f tempest-ProjectReaderTests-1678750332 None] Lock "cinder-76c6888b-c4dc-4bf6-801b-9aa9bb18f271-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-4367111f-6864-4e9b-99e5-ce35676e8e0f tempest-ProjectReaderTests-1678750332 None] Acquiring lock "cinder-quobyte-76c6888b-c4dc-4bf6-801b-9aa9bb18f271" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-4367111f-6864-4e9b-99e5-ce35676e8e0f tempest-ProjectReaderTests-1678750332 None] Lock "cinder-quobyte-76c6888b-c4dc-4bf6-801b-9aa9bb18f271" acquired by "delete_volume" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:47 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccec6693-3b03-47e2-b9f3-6b960e32aa3c]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4367111f-6864-4e9b-99e5-ce35676e8e0f tempest-ProjectReaderTests-1678750332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-76c6888b-c4dc-4bf6-801b-9aa9bb18f271 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:47 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-76c6888b-c4dc-4bf6-801b-9aa9bb18f271 Jul 10 00:41:47 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:48 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4367111f-6864-4e9b-99e5-ce35676e8e0f tempest-ProjectReaderTests-1678750332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-76c6888b-c4dc-4bf6-801b-9aa9bb18f271" returned: 0 in 0.747s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4367111f-6864-4e9b-99e5-ce35676e8e0f tempest-ProjectReaderTests-1678750332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-76c6888b-c4dc-4bf6-801b-9aa9bb18f271 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:48 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-76c6888b-c4dc-4bf6-801b-9aa9bb18f271 Jul 10 00:41:48 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:48 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4367111f-6864-4e9b-99e5-ce35676e8e0f tempest-ProjectReaderTests-1678750332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-76c6888b-c4dc-4bf6-801b-9aa9bb18f271" returned: 0 in 0.606s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:48 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-4367111f-6864-4e9b-99e5-ce35676e8e0f tempest-ProjectReaderTests-1678750332 None] Lock "cinder-quobyte-76c6888b-c4dc-4bf6-801b-9aa9bb18f271" released by "delete_volume" :: held 1.391s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:49 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-4367111f-6864-4e9b-99e5-ce35676e8e0f tempest-ProjectReaderTests-1678750332 None] Created reservations ['cfca186c-d6cd-401f-8f39-149bd42db632', '5dbb25b7-6dc7-414f-ae77-8989d3fd9767', '0ef58b91-d4fa-4b31-817d-cc6a6bebd66a', '848afcd0-a6b2-4640-955a-62c24a287a1b'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:41:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4367111f-6864-4e9b-99e5-ce35676e8e0f tempest-ProjectReaderTests-1678750332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4367111f-6864-4e9b-99e5-ce35676e8e0f tempest-ProjectReaderTests-1678750332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4367111f-6864-4e9b-99e5-ce35676e8e0f tempest-ProjectReaderTests-1678750332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4367111f-6864-4e9b-99e5-ce35676e8e0f tempest-ProjectReaderTests-1678750332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4367111f-6864-4e9b-99e5-ce35676e8e0f tempest-ProjectReaderTests-1678750332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4367111f-6864-4e9b-99e5-ce35676e8e0f tempest-ProjectReaderTests-1678750332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:49 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:41:49 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:49 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4367111f-6864-4e9b-99e5-ce35676e8e0f tempest-ProjectReaderTests-1678750332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.659s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:49 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-4367111f-6864-4e9b-99e5-ce35676e8e0f tempest-ProjectReaderTests-1678750332 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:41:49 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-4367111f-6864-4e9b-99e5-ce35676e8e0f tempest-ProjectReaderTests-1678750332 None] Deleted volume successfully. Jul 10 00:41:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-4367111f-6864-4e9b-99e5-ce35676e8e0f tempest-ProjectReaderTests-1678750332 None] Lock "cinder-76c6888b-c4dc-4bf6-801b-9aa9bb18f271-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:50 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:41:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Flow 'volume_create_manager' (e0c0ee6b-5cc2-4e62-94ac-419182e0ffa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:41:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402770e0-ee7c-4576-9be4-1a58b4d80a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (402770e0-ee7c-4576-9be4-1a58b4d80a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1724402463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4629cf81-e2c3-4d98-aa08-75ffecefb3bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5224a50af043d1a1b066173add6e1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:41:50Z,use_quota=True,user_id='05ea853d83974242b5cb09737332f1c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c18b3ece-7dc8-4e60-b58d-78c912b5751c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c18b3ece-7dc8-4e60-b58d-78c912b5751c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de9dd34-a436-466d-a31b-02c1757bfe1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de9dd34-a436-466d-a31b-02c1757bfe1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4629cf81-e2c3-4d98-aa08-75ffecefb3bb', 'volume_name': 'volume-4629cf81-e2c3-4d98-aa08-75ffecefb3bb', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2750fee4-57e7-4da7-bafd-08eb6364265a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2750fee4-57e7-4da7-bafd-08eb6364265a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718ee2e7-98ec-4e99-ac75-59608d771f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:50 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Volume 4629cf81-e2c3-4d98-aa08-75ffecefb3bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4629cf81-e2c3-4d98-aa08-75ffecefb3bb', 'volume_size': 1} Jul 10 00:41:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1724402463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4629cf81-e2c3-4d98-aa08-75ffecefb3bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5224a50af043d1a1b066173add6e1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:41:50Z,use_quota=True,user_id='05ea853d83974242b5cb09737332f1c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:41:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Creating volume 4629cf81-e2c3-4d98-aa08-75ffecefb3bb {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:41:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:41:50 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:41:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4629cf81-e2c3-4d98-aa08-75ffecefb3bb 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:50 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4629cf81-e2c3-4d98-aa08-75ffecefb3bb 1073741824 Jul 10 00:41:50 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:51 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4629cf81-e2c3-4d98-aa08-75ffecefb3bb 1073741824" returned: 0 in 0.846s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4629cf81-e2c3-4d98-aa08-75ffecefb3bb {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:51 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4629cf81-e2c3-4d98-aa08-75ffecefb3bb Jul 10 00:41:51 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:51 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4629cf81-e2c3-4d98-aa08-75ffecefb3bb" returned: 0 in 0.617s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:41:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718ee2e7-98ec-4e99-ac75-59608d771f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4629cf81-e2c3-4d98-aa08-75ffecefb3bb', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (137a945c-06ca-4d33-8608-b4b3078e2edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:41:52 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Volume volume-4629cf81-e2c3-4d98-aa08-75ffecefb3bb (4629cf81-e2c3-4d98-aa08-75ffecefb3bb): created successfully Jul 10 00:41:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (137a945c-06ca-4d33-8608-b4b3078e2edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:41:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Flow 'volume_create_manager' (e0c0ee6b-5cc2-4e62-94ac-419182e0ffa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:41:52 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-203a38ef-1e88-45c0-bc5c-dcae29616e28 tempest-ProjectReaderTests-1678750332 None] Created volume successfully. Jul 10 00:41:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-20be1110-c603-4e9a-b5b3-e0fbfbded2c8 tempest-ProjectReaderTests-1678750332 None] Acquiring lock "cinder-4629cf81-e2c3-4d98-aa08-75ffecefb3bb-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-20be1110-c603-4e9a-b5b3-e0fbfbded2c8 tempest-ProjectReaderTests-1678750332 None] Lock "cinder-4629cf81-e2c3-4d98-aa08-75ffecefb3bb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-20be1110-c603-4e9a-b5b3-e0fbfbded2c8 tempest-ProjectReaderTests-1678750332 None] Acquiring lock "cinder-quobyte-4629cf81-e2c3-4d98-aa08-75ffecefb3bb" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:41:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-20be1110-c603-4e9a-b5b3-e0fbfbded2c8 tempest-ProjectReaderTests-1678750332 None] Lock "cinder-quobyte-4629cf81-e2c3-4d98-aa08-75ffecefb3bb" acquired by "delete_volume" :: waited 0.014s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:41:52 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b25744-a1a6-4184-8390-573542591952]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:41:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-20be1110-c603-4e9a-b5b3-e0fbfbded2c8 tempest-ProjectReaderTests-1678750332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4629cf81-e2c3-4d98-aa08-75ffecefb3bb {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:52 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4629cf81-e2c3-4d98-aa08-75ffecefb3bb Jul 10 00:41:52 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:53 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-20be1110-c603-4e9a-b5b3-e0fbfbded2c8 tempest-ProjectReaderTests-1678750332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4629cf81-e2c3-4d98-aa08-75ffecefb3bb" returned: 0 in 0.763s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-20be1110-c603-4e9a-b5b3-e0fbfbded2c8 tempest-ProjectReaderTests-1678750332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4629cf81-e2c3-4d98-aa08-75ffecefb3bb {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:53 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4629cf81-e2c3-4d98-aa08-75ffecefb3bb Jul 10 00:41:53 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:54 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-20be1110-c603-4e9a-b5b3-e0fbfbded2c8 tempest-ProjectReaderTests-1678750332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4629cf81-e2c3-4d98-aa08-75ffecefb3bb" returned: 0 in 0.652s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-20be1110-c603-4e9a-b5b3-e0fbfbded2c8 tempest-ProjectReaderTests-1678750332 None] Lock "cinder-quobyte-4629cf81-e2c3-4d98-aa08-75ffecefb3bb" released by "delete_volume" :: held 1.456s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:41:54 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-20be1110-c603-4e9a-b5b3-e0fbfbded2c8 tempest-ProjectReaderTests-1678750332 None] Created reservations ['d1327ba6-a768-40d0-9b71-a39fc33fa18d', '1b588091-837e-4c86-af44-f051e27f8c01', '1d23ef15-9a7a-4b17-938a-b9f37f076c22', '0966669f-9bee-4b24-bc40-55e0b004c8e6'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:41:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-20be1110-c603-4e9a-b5b3-e0fbfbded2c8 tempest-ProjectReaderTests-1678750332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:41:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-20be1110-c603-4e9a-b5b3-e0fbfbded2c8 tempest-ProjectReaderTests-1678750332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:41:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-20be1110-c603-4e9a-b5b3-e0fbfbded2c8 tempest-ProjectReaderTests-1678750332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:41:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-20be1110-c603-4e9a-b5b3-e0fbfbded2c8 tempest-ProjectReaderTests-1678750332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:41:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-20be1110-c603-4e9a-b5b3-e0fbfbded2c8 tempest-ProjectReaderTests-1678750332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:41:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-20be1110-c603-4e9a-b5b3-e0fbfbded2c8 tempest-ProjectReaderTests-1678750332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:41:54 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:41:54 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:41:54 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Jul 10 00:41:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-20be1110-c603-4e9a-b5b3-e0fbfbded2c8 tempest-ProjectReaderTests-1678750332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.650s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:41:54 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-20be1110-c603-4e9a-b5b3-e0fbfbded2c8 tempest-ProjectReaderTests-1678750332 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:41:54 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-20be1110-c603-4e9a-b5b3-e0fbfbded2c8 tempest-ProjectReaderTests-1678750332 None] Deleted volume successfully. Jul 10 00:41:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-20be1110-c603-4e9a-b5b3-e0fbfbded2c8 tempest-ProjectReaderTests-1678750332 None] Lock "cinder-4629cf81-e2c3-4d98-aa08-75ffecefb3bb-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:42:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-a9cfe76e-3c68-4458-a0c4-7defcd0652a5 req-f15232d0-6b68-416b-bf4a-8ed25e549b60 tempest-TestStampPattern-377134180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:42:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-a9cfe76e-3c68-4458-a0c4-7defcd0652a5 req-f15232d0-6b68-416b-bf4a-8ed25e549b60 tempest-TestStampPattern-377134180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:00 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee896c5-7a53-4fad-93ea-fb1b79254fe9]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:42:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-a9cfe76e-3c68-4458-a0c4-7defcd0652a5 req-f15232d0-6b68-416b-bf4a-8ed25e549b60 tempest-TestStampPattern-377134180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:00 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e Jul 10 00:42:00 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:01 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-a9cfe76e-3c68-4458-a0c4-7defcd0652a5 req-f15232d0-6b68-416b-bf4a-8ed25e549b60 tempest-TestStampPattern-377134180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e" returned: 0 in 0.785s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-a9cfe76e-3c68-4458-a0c4-7defcd0652a5 req-f15232d0-6b68-416b-bf4a-8ed25e549b60 tempest-TestStampPattern-377134180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.801s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:01 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-a9cfe76e-3c68-4458-a0c4-7defcd0652a5 req-f15232d0-6b68-416b-bf4a-8ed25e549b60 tempest-TestStampPattern-377134180 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff', 'name': 'volume-566336b2-112f-4be9-bd3c-d6ee05c2384e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f2967f4-392d-41ff-a1fb-a584b65db853', 'enforce_multipath': True} {{(pid=88119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 10 00:42:01 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-a9cfe76e-3c68-4458-a0c4-7defcd0652a5 req-f15232d0-6b68-416b-bf4a-8ed25e549b60 tempest-TestStampPattern-377134180 None] attachment_update completed successfully. Jul 10 00:42:06 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=74,cinder:INSERT=33,cinder:UPDATE=113,cinder:DELETE=9 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:42:06 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:INSERT=18,cinder:UPDATE=108,cinder:SELECT=72,cinder:DELETE=9 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:42:09 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-07c9a680-e053-4c39-a0e4-3c1ef598f3f8 req-f684050f-8554-4206-af26-fb04907efed4 tempest-TestStampPattern-377134180 None] Terminate volume connection completed successfully. Jul 10 00:42:09 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-07c9a680-e053-4c39-a0e4-3c1ef598f3f8 req-f684050f-8554-4206-af26-fb04907efed4 tempest-TestStampPattern-377134180 None] Deleting attachment 9f2967f4-392d-41ff-a1fb-a584b65db853. {{(pid=88119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 10 00:42:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a7cc0e59-a005-4161-901c-965186383fbe tempest-TestStampPattern-377134180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:42:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a7cc0e59-a005-4161-901c-965186383fbe tempest-TestStampPattern-377134180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-a7cc0e59-a005-4161-901c-965186383fbe tempest-TestStampPattern-377134180 None] Creating offline snapshot 659529f0-3e94-45fd-ad84-cc2a98a4304e of volume 566336b2-112f-4be9-bd3c-d6ee05c2384e {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:42:11 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a104f04-88a8-403e-b861-9df1a43a01fd]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:42:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7cc0e59-a005-4161-901c-965186383fbe tempest-TestStampPattern-377134180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:11 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e Jul 10 00:42:11 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:12 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7cc0e59-a005-4161-901c-965186383fbe tempest-TestStampPattern-377134180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e" returned: 0 in 0.806s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7cc0e59-a005-4161-901c-965186383fbe tempest-TestStampPattern-377134180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.659529f0-3e94-45fd-ad84-cc2a98a4304e 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:12 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.659529f0-3e94-45fd-ad84-cc2a98a4304e 1G Jul 10 00:42:12 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:13 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7cc0e59-a005-4161-901c-965186383fbe tempest-TestStampPattern-377134180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.659529f0-3e94-45fd-ad84-cc2a98a4304e 1G" returned: 0 in 0.812s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7cc0e59-a005-4161-901c-965186383fbe tempest-TestStampPattern-377134180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-566336b2-112f-4be9-bd3c-d6ee05c2384e -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.659529f0-3e94-45fd-ad84-cc2a98a4304e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:13 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-566336b2-112f-4be9-bd3c-d6ee05c2384e -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.659529f0-3e94-45fd-ad84-cc2a98a4304e Jul 10 00:42:13 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:13 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7cc0e59-a005-4161-901c-965186383fbe tempest-TestStampPattern-377134180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-566336b2-112f-4be9-bd3c-d6ee05c2384e -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.659529f0-3e94-45fd-ad84-cc2a98a4304e" returned: 0 in 0.684s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:13 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-a7cc0e59-a005-4161-901c-965186383fbe tempest-TestStampPattern-377134180 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.659529f0-3e94-45fd-ad84-cc2a98a4304e is being set with open permissions: ugo+rw Jul 10 00:42:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7cc0e59-a005-4161-901c-965186383fbe tempest-TestStampPattern-377134180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.659529f0-3e94-45fd-ad84-cc2a98a4304e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:13 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.659529f0-3e94-45fd-ad84-cc2a98a4304e Jul 10 00:42:14 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:14 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7cc0e59-a005-4161-901c-965186383fbe tempest-TestStampPattern-377134180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.659529f0-3e94-45fd-ad84-cc2a98a4304e" returned: 0 in 0.601s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7cc0e59-a005-4161-901c-965186383fbe tempest-TestStampPattern-377134180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:14 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.info Jul 10 00:42:14 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:15 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7cc0e59-a005-4161-901c-965186383fbe tempest-TestStampPattern-377134180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.info" returned: 0 in 0.613s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:15 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-a7cc0e59-a005-4161-901c-965186383fbe tempest-TestStampPattern-377134180 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.info is being set with open permissions: ugo+rw Jul 10 00:42:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7cc0e59-a005-4161-901c-965186383fbe tempest-TestStampPattern-377134180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:15 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.info Jul 10 00:42:15 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:15 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7cc0e59-a005-4161-901c-965186383fbe tempest-TestStampPattern-377134180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.info" returned: 0 in 0.636s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a7cc0e59-a005-4161-901c-965186383fbe tempest-TestStampPattern-377134180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.235s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:15 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-a7cc0e59-a005-4161-901c-965186383fbe tempest-TestStampPattern-377134180 None] Create snapshot completed successfully Jul 10 00:42:25 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:42:25 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Flow 'volume_create_manager' (4667ebe9-8935-4c68-803c-dd6248b9c585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df70fdfb-8710-43ee-8ef3-53a9fc0d521a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df70fdfb-8710-43ee-8ef3-53a9fc0d521a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-58212219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f299e4-a03a-4d9e-bac9-4ae17238902a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c01d3e73fef4875a1e620c0b04604f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=659529f0-3e94-45fd-ad84-cc2a98a4304e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:42:27Z,use_quota=True,user_id='778c18dca7f34ce18d133ed79e6064bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd55039b-39db-40cc-bc0a-5283ac33c46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd55039b-39db-40cc-bc0a-5283ac33c46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29027f12-5194-42ea-9762-63f5f2b24cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29027f12-5194-42ea-9762-63f5f2b24cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a2f299e4-a03a-4d9e-bac9-4ae17238902a', 'volume_name': 'volume-a2f299e4-a03a-4d9e-bac9-4ae17238902a', 'volume_size': 1, 'snapshot_id': '659529f0-3e94-45fd-ad84-cc2a98a4304e'}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4598c74b-5624-4f6a-bfbc-fbb480f4f101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4598c74b-5624-4f6a-bfbc-fbb480f4f101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afdf3c17-c923-48e7-88f3-4c665376a66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:26 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Volume a2f299e4-a03a-4d9e-bac9-4ae17238902a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a2f299e4-a03a-4d9e-bac9-4ae17238902a', 'volume_size': 1, 'snapshot_id': '659529f0-3e94-45fd-ad84-cc2a98a4304e'} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Acquiring lock "cinder-quobyte-659529f0-3e94-45fd-ad84-cc2a98a4304e-a2f299e4-a03a-4d9e-bac9-4ae17238902a" by "_create_volume_from_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Lock "cinder-quobyte-659529f0-3e94-45fd-ad84-cc2a98a4304e-a2f299e4-a03a-4d9e-bac9-4ae17238902a" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Creating volume a2f299e4-a03a-4d9e-bac9-4ae17238902a from snapshot 659529f0-3e94-45fd-ad84-cc2a98a4304e {{(pid=88119) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Acquiring lock "cinder-quobyte-a2f299e4-a03a-4d9e-bac9-4ae17238902a" by "_copy_volume_from_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Lock "cinder-quobyte-a2f299e4-a03a-4d9e-bac9-4ae17238902a" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] snapshot: 659529f0-3e94-45fd-ad84-cc2a98a4304e, volume: a2f299e4-a03a-4d9e-bac9-4ae17238902a, {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5577d380-3cfb-4bf6-91d6-90bbea2f5c9e]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:42:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.659529f0-3e94-45fd-ad84-cc2a98a4304e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:26 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.659529f0-3e94-45fd-ad84-cc2a98a4304e Jul 10 00:42:26 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:27 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.659529f0-3e94-45fd-ad84-cc2a98a4304e" returned: 0 in 0.807s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:27 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-566336b2-112f-4be9-bd3c-d6ee05c2384e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:42:27 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 00:42:27 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Creating direct copy from snapshot {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 00:42:27 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57e55d0-4552-4a27-af1d-e94a994849d6]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:42:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:27 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e Jul 10 00:42:27 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:28 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e" returned: 0 in 0.752s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:28 devstack cinder-volume[88119]: DEBUG cinder.utils [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Path /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a2f299e4-a03a-4d9e-bac9-4ae17238902a not found in is_blk_device check {{(pid=88119) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 00:42:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a2f299e4-a03a-4d9e-bac9-4ae17238902a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:28 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a2f299e4-a03a-4d9e-bac9-4ae17238902a Jul 10 00:42:28 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:42:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:42:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:42:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:42:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:42:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:31 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:42:31 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:33 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a2f299e4-a03a-4d9e-bac9-4ae17238902a" returned: 0 in 4.877s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:33 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f79db4-f1d7-4439-bac4-ce5a8fa8ca95]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:42:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:33 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e Jul 10 00:42:33 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:33 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.700s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:33 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:42:33 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:42:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 29 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:42:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:42:34 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e" returned: 0 in 1.133s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:34 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Image conversion details: src /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e, size 1024.00 MB, duration 4.88 sec, destination /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a2f299e4-a03a-4d9e-bac9-4ae17238902a {{(pid=88119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:42:34 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Converted 1024.00 MB image at 209.88 MB/s Jul 10 00:42:34 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a2f299e4-a03a-4d9e-bac9-4ae17238902a is being set with open permissions: ugo+rw Jul 10 00:42:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a2f299e4-a03a-4d9e-bac9-4ae17238902a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:42:34 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a2f299e4-a03a-4d9e-bac9-4ae17238902a Jul 10 00:42:34 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:42:35 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jul 10 00:42:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a2f299e4-a03a-4d9e-bac9-4ae17238902a" returned: 0 in 0.801s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:42:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Lock "cinder-quobyte-a2f299e4-a03a-4d9e-bac9-4ae17238902a" released by "_copy_volume_from_snapshot" :: held 8.479s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:42:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Lock "cinder-quobyte-659529f0-3e94-45fd-ad84-cc2a98a4304e-a2f299e4-a03a-4d9e-bac9-4ae17238902a" released by "_create_volume_from_snapshot" :: held 8.512s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:42:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.527s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:42:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afdf3c17-c923-48e7-88f3-4c665376a66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2f299e4-a03a-4d9e-bac9-4ae17238902a', 'volume_size': 1, 'snapshot_id': '659529f0-3e94-45fd-ad84-cc2a98a4304e'}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1efaafe-fe82-45b8-8a84-9a0b4c51f921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:42:35 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Volume volume-a2f299e4-a03a-4d9e-bac9-4ae17238902a (a2f299e4-a03a-4d9e-bac9-4ae17238902a): created successfully Jul 10 00:42:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1efaafe-fe82-45b8-8a84-9a0b4c51f921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:42:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Flow 'volume_create_manager' (4667ebe9-8935-4c68-803c-dd6248b9c585) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:42:35 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-15e17fba-1f89-472d-a045-e8e515ee1a68 tempest-TestStampPattern-377134180 None] Created volume successfully. Jul 10 00:42:45 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:42:45 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:DELETE=1 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:43:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-33ee7209-c798-479a-a2e5-d57c8130dd18 req-f6819dc2-5efd-4ba2-947b-50caccda4d4f tempest-TestStampPattern-377134180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:43:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-33ee7209-c798-479a-a2e5-d57c8130dd18 req-f6819dc2-5efd-4ba2-947b-50caccda4d4f tempest-TestStampPattern-377134180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:43:22 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[36898f65-457c-46ca-9681-e35b4a14765c]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:43:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-33ee7209-c798-479a-a2e5-d57c8130dd18 req-f6819dc2-5efd-4ba2-947b-50caccda4d4f tempest-TestStampPattern-377134180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a2f299e4-a03a-4d9e-bac9-4ae17238902a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:43:23 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a2f299e4-a03a-4d9e-bac9-4ae17238902a Jul 10 00:43:23 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:43:23 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Jul 10 00:43:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [req-33ee7209-c798-479a-a2e5-d57c8130dd18 req-f6819dc2-5efd-4ba2-947b-50caccda4d4f tempest-TestStampPattern-377134180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a2f299e4-a03a-4d9e-bac9-4ae17238902a" returned: 0 in 0.755s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:43:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [req-33ee7209-c798-479a-a2e5-d57c8130dd18 req-f6819dc2-5efd-4ba2-947b-50caccda4d4f tempest-TestStampPattern-377134180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.772s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:43:23 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-33ee7209-c798-479a-a2e5-d57c8130dd18 req-f6819dc2-5efd-4ba2-947b-50caccda4d4f tempest-TestStampPattern-377134180 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff', 'name': 'volume-a2f299e4-a03a-4d9e-bac9-4ae17238902a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5e0e5bee-137a-487a-be56-398cfe251f2b', 'enforce_multipath': True} {{(pid=88119) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4925}} Jul 10 00:43:23 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-33ee7209-c798-479a-a2e5-d57c8130dd18 req-f6819dc2-5efd-4ba2-947b-50caccda4d4f tempest-TestStampPattern-377134180 None] attachment_update completed successfully. Jul 10 00:43:30 devstack cinder-volume[88119]: INFO cinder.volume.manager [req-c67f170b-52ea-4276-b993-55a6eb82422e req-36b4215f-351f-4cc6-a434-cd2878d3c2b6 tempest-TestStampPattern-377134180 None] Terminate volume connection completed successfully. Jul 10 00:43:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [req-c67f170b-52ea-4276-b993-55a6eb82422e req-36b4215f-351f-4cc6-a434-cd2878d3c2b6 tempest-TestStampPattern-377134180 None] Deleting attachment 5e0e5bee-137a-487a-be56-398cfe251f2b. {{(pid=88119) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5056}} Jul 10 00:43:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:43:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:43:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:43:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:43:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:43:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:43:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:43:31 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:43:31 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:43:32 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Jul 10 00:43:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.616s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:43:32 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:43:32 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:43:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 29 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:43:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:43:40 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:43:40 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:43:40 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-dff0f388-89a6-4011-8360-d17d3269631a tempest-TestStampPattern-377134180 None] Acquiring lock "cinder-a2f299e4-a03a-4d9e-bac9-4ae17238902a-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:43:40 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-dff0f388-89a6-4011-8360-d17d3269631a tempest-TestStampPattern-377134180 None] Lock "cinder-a2f299e4-a03a-4d9e-bac9-4ae17238902a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:43:41 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-dff0f388-89a6-4011-8360-d17d3269631a tempest-TestStampPattern-377134180 None] Acquiring lock "cinder-quobyte-a2f299e4-a03a-4d9e-bac9-4ae17238902a" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:43:41 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-dff0f388-89a6-4011-8360-d17d3269631a tempest-TestStampPattern-377134180 None] Lock "cinder-quobyte-a2f299e4-a03a-4d9e-bac9-4ae17238902a" acquired by "delete_volume" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:43:41 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdf3aac-3551-482d-8c14-73e842f0db8b]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:43:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dff0f388-89a6-4011-8360-d17d3269631a tempest-TestStampPattern-377134180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a2f299e4-a03a-4d9e-bac9-4ae17238902a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:43:41 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a2f299e4-a03a-4d9e-bac9-4ae17238902a Jul 10 00:43:41 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:43:41 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Jul 10 00:43:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dff0f388-89a6-4011-8360-d17d3269631a tempest-TestStampPattern-377134180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a2f299e4-a03a-4d9e-bac9-4ae17238902a" returned: 0 in 0.743s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:43:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dff0f388-89a6-4011-8360-d17d3269631a tempest-TestStampPattern-377134180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a2f299e4-a03a-4d9e-bac9-4ae17238902a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:43:41 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a2f299e4-a03a-4d9e-bac9-4ae17238902a Jul 10 00:43:41 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:43:42 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Jul 10 00:43:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dff0f388-89a6-4011-8360-d17d3269631a tempest-TestStampPattern-377134180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a2f299e4-a03a-4d9e-bac9-4ae17238902a" returned: 0 in 0.614s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:43:42 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-dff0f388-89a6-4011-8360-d17d3269631a tempest-TestStampPattern-377134180 None] Lock "cinder-quobyte-a2f299e4-a03a-4d9e-bac9-4ae17238902a" released by "delete_volume" :: held 1.395s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:43:42 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-dff0f388-89a6-4011-8360-d17d3269631a tempest-TestStampPattern-377134180 None] Created reservations ['65a4bc15-60d2-4537-b721-8fa935ee2e95', 'c0d5e0b6-3e0b-4afd-86b4-0721285a60ae', '3918a40d-d87c-44ab-870a-bdbf9585ad88', '54357e98-df90-4f3c-95ca-5adf00dfbb72'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:43:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dff0f388-89a6-4011-8360-d17d3269631a tempest-TestStampPattern-377134180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:43:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dff0f388-89a6-4011-8360-d17d3269631a tempest-TestStampPattern-377134180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:43:42 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-dff0f388-89a6-4011-8360-d17d3269631a tempest-TestStampPattern-377134180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:43:42 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-dff0f388-89a6-4011-8360-d17d3269631a tempest-TestStampPattern-377134180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:43:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dff0f388-89a6-4011-8360-d17d3269631a tempest-TestStampPattern-377134180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:43:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dff0f388-89a6-4011-8360-d17d3269631a tempest-TestStampPattern-377134180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:43:42 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:43:42 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:43:43 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jul 10 00:43:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dff0f388-89a6-4011-8360-d17d3269631a tempest-TestStampPattern-377134180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.614s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:43:43 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-dff0f388-89a6-4011-8360-d17d3269631a tempest-TestStampPattern-377134180 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:43:43 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-dff0f388-89a6-4011-8360-d17d3269631a tempest-TestStampPattern-377134180 None] Deleted volume successfully. Jul 10 00:43:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-dff0f388-89a6-4011-8360-d17d3269631a tempest-TestStampPattern-377134180 None] Lock "cinder-a2f299e4-a03a-4d9e-bac9-4ae17238902a-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:43:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8f3960b9-451c-40f2-8547-586c2a8090cb tempest-TestStampPattern-377134180 None] Acquiring lock "cinder-659529f0-3e94-45fd-ad84-cc2a98a4304e-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:43:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8f3960b9-451c-40f2-8547-586c2a8090cb tempest-TestStampPattern-377134180 None] Lock "cinder-659529f0-3e94-45fd-ad84-cc2a98a4304e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:43:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8f3960b9-451c-40f2-8547-586c2a8090cb tempest-TestStampPattern-377134180 None] Acquiring lock "cinder-quobyte-566336b2-112f-4be9-bd3c-d6ee05c2384e" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:43:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8f3960b9-451c-40f2-8547-586c2a8090cb tempest-TestStampPattern-377134180 None] Lock "cinder-quobyte-566336b2-112f-4be9-bd3c-d6ee05c2384e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:43:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8f3960b9-451c-40f2-8547-586c2a8090cb tempest-TestStampPattern-377134180 None] Acquiring lock "cinder-quobyte-659529f0-3e94-45fd-ad84-cc2a98a4304e" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:43:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8f3960b9-451c-40f2-8547-586c2a8090cb tempest-TestStampPattern-377134180 None] Lock "cinder-quobyte-659529f0-3e94-45fd-ad84-cc2a98a4304e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:43:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8f3960b9-451c-40f2-8547-586c2a8090cb tempest-TestStampPattern-377134180 None] Deleting offline snapshot 659529f0-3e94-45fd-ad84-cc2a98a4304e of volume 566336b2-112f-4be9-bd3c-d6ee05c2384e {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:43:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8f3960b9-451c-40f2-8547-586c2a8090cb tempest-TestStampPattern-377134180 None] snapshot_file for this snap is: volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.659529f0-3e94-45fd-ad84-cc2a98a4304e {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:43:43 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[608872fc-7e99-4e5e-aa87-869cde3086a9]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:43:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8f3960b9-451c-40f2-8547-586c2a8090cb tempest-TestStampPattern-377134180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.659529f0-3e94-45fd-ad84-cc2a98a4304e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:43:43 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.659529f0-3e94-45fd-ad84-cc2a98a4304e Jul 10 00:43:43 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:43:44 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Jul 10 00:43:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8f3960b9-451c-40f2-8547-586c2a8090cb tempest-TestStampPattern-377134180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.659529f0-3e94-45fd-ad84-cc2a98a4304e" returned: 0 in 0.729s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:43:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8f3960b9-451c-40f2-8547-586c2a8090cb tempest-TestStampPattern-377134180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-566336b2-112f-4be9-bd3c-d6ee05c2384e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:43:44 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e30553-5734-4bcf-b873-096ecb31372a]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:43:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8f3960b9-451c-40f2-8547-586c2a8090cb tempest-TestStampPattern-377134180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:43:44 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e Jul 10 00:43:44 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:43:45 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jul 10 00:43:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8f3960b9-451c-40f2-8547-586c2a8090cb tempest-TestStampPattern-377134180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e" returned: 0 in 0.719s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:43:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8f3960b9-451c-40f2-8547-586c2a8090cb tempest-TestStampPattern-377134180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.659529f0-3e94-45fd-ad84-cc2a98a4304e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:43:45 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.659529f0-3e94-45fd-ad84-cc2a98a4304e Jul 10 00:43:45 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:43:45 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 10 00:43:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8f3960b9-451c-40f2-8547-586c2a8090cb tempest-TestStampPattern-377134180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.659529f0-3e94-45fd-ad84-cc2a98a4304e" returned: 0 in 0.703s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:43:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8f3960b9-451c-40f2-8547-586c2a8090cb tempest-TestStampPattern-377134180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.659529f0-3e94-45fd-ad84-cc2a98a4304e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:43:45 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.659529f0-3e94-45fd-ad84-cc2a98a4304e Jul 10 00:43:45 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:43:46 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 10 00:43:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8f3960b9-451c-40f2-8547-586c2a8090cb tempest-TestStampPattern-377134180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e.659529f0-3e94-45fd-ad84-cc2a98a4304e" returned: 0 in 0.646s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:43:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8f3960b9-451c-40f2-8547-586c2a8090cb tempest-TestStampPattern-377134180 None] Lock "cinder-quobyte-659529f0-3e94-45fd-ad84-cc2a98a4304e" released by "_delete_snapshot" :: held 2.884s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:43:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8f3960b9-451c-40f2-8547-586c2a8090cb tempest-TestStampPattern-377134180 None] Lock "cinder-quobyte-566336b2-112f-4be9-bd3c-d6ee05c2384e" released by "delete_snapshot" :: held 2.905s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:43:46 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-8f3960b9-451c-40f2-8547-586c2a8090cb tempest-TestStampPattern-377134180 None] Created reservations ['1937b531-734d-40ab-99cf-c30580a813b0', '72044e86-d178-4d5d-9410-01699ff6893b', '35efc391-f4f1-4b0f-9dd1-d16f53e6c580', '997ce7ed-652e-4b6f-8173-ecb33432dab0'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:43:46 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-8f3960b9-451c-40f2-8547-586c2a8090cb tempest-TestStampPattern-377134180 None] Delete snapshot completed successfully. Jul 10 00:43:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8f3960b9-451c-40f2-8547-586c2a8090cb tempest-TestStampPattern-377134180 None] Lock "cinder-659529f0-3e94-45fd-ad84-cc2a98a4304e-delete_snapshot" released by "delete_snapshot" :: held 3.031s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:43:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-954ea5a1-7196-42e5-8ae3-43c3d6c2f37f tempest-TestStampPattern-377134180 None] Acquiring lock "cinder-566336b2-112f-4be9-bd3c-d6ee05c2384e-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:43:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-954ea5a1-7196-42e5-8ae3-43c3d6c2f37f tempest-TestStampPattern-377134180 None] Lock "cinder-566336b2-112f-4be9-bd3c-d6ee05c2384e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:43:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-954ea5a1-7196-42e5-8ae3-43c3d6c2f37f tempest-TestStampPattern-377134180 None] Acquiring lock "cinder-quobyte-566336b2-112f-4be9-bd3c-d6ee05c2384e" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:43:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-954ea5a1-7196-42e5-8ae3-43c3d6c2f37f tempest-TestStampPattern-377134180 None] Lock "cinder-quobyte-566336b2-112f-4be9-bd3c-d6ee05c2384e" acquired by "delete_volume" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:43:54 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b40045-fd09-4d07-ba55-10a49d3cf6c5]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:43:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-954ea5a1-7196-42e5-8ae3-43c3d6c2f37f tempest-TestStampPattern-377134180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:43:54 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e Jul 10 00:43:54 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:43:55 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Jul 10 00:43:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-954ea5a1-7196-42e5-8ae3-43c3d6c2f37f tempest-TestStampPattern-377134180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e" returned: 0 in 0.719s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:43:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-954ea5a1-7196-42e5-8ae3-43c3d6c2f37f tempest-TestStampPattern-377134180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:43:55 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e Jul 10 00:43:55 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:43:56 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Jul 10 00:43:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-954ea5a1-7196-42e5-8ae3-43c3d6c2f37f tempest-TestStampPattern-377134180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-566336b2-112f-4be9-bd3c-d6ee05c2384e" returned: 0 in 0.620s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:43:56 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-954ea5a1-7196-42e5-8ae3-43c3d6c2f37f tempest-TestStampPattern-377134180 None] Lock "cinder-quobyte-566336b2-112f-4be9-bd3c-d6ee05c2384e" released by "delete_volume" :: held 1.391s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:43:56 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-954ea5a1-7196-42e5-8ae3-43c3d6c2f37f tempest-TestStampPattern-377134180 None] Created reservations ['5494e0b6-b2ad-4c25-9066-da81ea351133', '59ee34a6-24cd-4891-924e-f0e1c0a59fe2', '45453795-4356-497a-abbb-df27bfad240c', 'cf43a91a-e734-4c77-bb0f-eb562d6f32f9'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:43:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-954ea5a1-7196-42e5-8ae3-43c3d6c2f37f tempest-TestStampPattern-377134180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:43:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-954ea5a1-7196-42e5-8ae3-43c3d6c2f37f tempest-TestStampPattern-377134180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:43:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-954ea5a1-7196-42e5-8ae3-43c3d6c2f37f tempest-TestStampPattern-377134180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:43:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-954ea5a1-7196-42e5-8ae3-43c3d6c2f37f tempest-TestStampPattern-377134180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:43:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-954ea5a1-7196-42e5-8ae3-43c3d6c2f37f tempest-TestStampPattern-377134180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:43:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-954ea5a1-7196-42e5-8ae3-43c3d6c2f37f tempest-TestStampPattern-377134180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:43:56 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:43:56 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:43:56 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jul 10 00:43:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-954ea5a1-7196-42e5-8ae3-43c3d6c2f37f tempest-TestStampPattern-377134180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.608s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:43:56 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-954ea5a1-7196-42e5-8ae3-43c3d6c2f37f tempest-TestStampPattern-377134180 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:43:56 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-954ea5a1-7196-42e5-8ae3-43c3d6c2f37f tempest-TestStampPattern-377134180 None] Deleted volume successfully. Jul 10 00:43:56 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-954ea5a1-7196-42e5-8ae3-43c3d6c2f37f tempest-TestStampPattern-377134180 None] Lock "cinder-566336b2-112f-4be9-bd3c-d6ee05c2384e-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:06 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=15,cinder:INSERT=7,cinder:UPDATE=20 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Flow 'volume_create_manager' (cfdc813c-1871-45d0-bdf5-ef7ab933a505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abed1647-1991-418a-aa04-694014841a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abed1647-1991-418a-aa04-694014841a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1821449779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70232198-b6e7-4876-9fff-c56fddb624ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c57414a744480ab66b228bc2e1a0d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:07Z,use_quota=True,user_id='397f3a9a4b2a4ed48f2f345a3b30d515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (167f72f3-a1ce-4451-92b7-2c92ffb3e158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (167f72f3-a1ce-4451-92b7-2c92ffb3e158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d07db9-66a8-4ab4-bdd3-407d45c0dd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64d07db9-66a8-4ab4-bdd3-407d45c0dd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70232198-b6e7-4876-9fff-c56fddb624ea', 'volume_name': 'volume-70232198-b6e7-4876-9fff-c56fddb624ea', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011ac42d-7e68-4edb-b94d-ee1c26ca6f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011ac42d-7e68-4edb-b94d-ee1c26ca6f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ec13ee-b501-41de-9cb2-a40acc2b0347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:07 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Volume 70232198-b6e7-4876-9fff-c56fddb624ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70232198-b6e7-4876-9fff-c56fddb624ea', 'volume_size': 1} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1821449779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70232198-b6e7-4876-9fff-c56fddb624ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c57414a744480ab66b228bc2e1a0d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:07Z,use_quota=True,user_id='397f3a9a4b2a4ed48f2f345a3b30d515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Creating volume 70232198-b6e7-4876-9fff-c56fddb624ea {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:44:07 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-70232198-b6e7-4876-9fff-c56fddb624ea 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:07 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-70232198-b6e7-4876-9fff-c56fddb624ea 1073741824 Jul 10 00:44:07 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Flow 'volume_create_manager' (b29922ba-eeaa-4051-a8e6-d4c87e8af978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eebb57ea-355b-42be-baaf-85182a229398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eebb57ea-355b-42be-baaf-85182a229398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1705965882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2df8d11f-634f-4390-85a0-b3e7dceaa8bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c57414a744480ab66b228bc2e1a0d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:07Z,use_quota=True,user_id='397f3a9a4b2a4ed48f2f345a3b30d515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8628a62c-dc09-4196-8b68-40f536b46b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8628a62c-dc09-4196-8b68-40f536b46b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c05a8f2-cec8-4e0b-bda4-b0ef3dbf26d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c05a8f2-cec8-4e0b-bda4-b0ef3dbf26d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2df8d11f-634f-4390-85a0-b3e7dceaa8bd', 'volume_name': 'volume-2df8d11f-634f-4390-85a0-b3e7dceaa8bd', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c339eedf-20f4-4966-8648-a2e5a199a485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c339eedf-20f4-4966-8648-a2e5a199a485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df80bfd9-4563-493c-9511-58aa1e37778f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:07 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Volume 2df8d11f-634f-4390-85a0-b3e7dceaa8bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2df8d11f-634f-4390-85a0-b3e7dceaa8bd', 'volume_size': 1} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Flow 'volume_create_manager' (dab618a6-07da-4bfd-88ba-d1fc42484d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217b6a5f-efbe-46a7-962a-76683b547d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217b6a5f-efbe-46a7-962a-76683b547d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-936864996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e5ab2a8-157f-4a12-8212-728305d578a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c57414a744480ab66b228bc2e1a0d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:08Z,use_quota=True,user_id='397f3a9a4b2a4ed48f2f345a3b30d515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe329b7-5cc1-428b-a6e8-603b0c93b050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe329b7-5cc1-428b-a6e8-603b0c93b050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d0ed58d-d205-41ca-9b45-dfe6d2622688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d0ed58d-d205-41ca-9b45-dfe6d2622688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e5ab2a8-157f-4a12-8212-728305d578a5', 'volume_name': 'volume-9e5ab2a8-157f-4a12-8212-728305d578a5', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f29f193c-abfe-4717-b17b-0eb62cde531b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f29f193c-abfe-4717-b17b-0eb62cde531b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f92b13-2be6-483e-b6bc-64a470dad49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:07 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Volume 9e5ab2a8-157f-4a12-8212-728305d578a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e5ab2a8-157f-4a12-8212-728305d578a5', 'volume_size': 1} Jul 10 00:44:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:08 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-70232198-b6e7-4876-9fff-c56fddb624ea 1073741824" returned: 0 in 0.965s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Flow 'volume_create_manager' (97051eda-1da3-48ab-a1d5-f69569eaae4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b2a461b-e51a-4fbd-bfca-c3b1900e3e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b2a461b-e51a-4fbd-bfca-c3b1900e3e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-154409092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3deb26c2-18c1-43c3-81f5-47e601f91811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c57414a744480ab66b228bc2e1a0d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:08Z,use_quota=True,user_id='397f3a9a4b2a4ed48f2f345a3b30d515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4e9763-5553-4acc-9fe7-facb6fcda217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4e9763-5553-4acc-9fe7-facb6fcda217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24692cad-5f86-48ef-98ce-d8993cb98257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24692cad-5f86-48ef-98ce-d8993cb98257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3deb26c2-18c1-43c3-81f5-47e601f91811', 'volume_name': 'volume-3deb26c2-18c1-43c3-81f5-47e601f91811', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279483fc-64c4-4c8e-8149-c52242126c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279483fc-64c4-4c8e-8149-c52242126c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da5a8ece-ab4c-44f8-be24-105fadd7652b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:08 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Volume 3deb26c2-18c1-43c3-81f5-47e601f91811: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3deb26c2-18c1-43c3-81f5-47e601f91811', 'volume_size': 1} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-70232198-b6e7-4876-9fff-c56fddb624ea {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:08 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-70232198-b6e7-4876-9fff-c56fddb624ea Jul 10 00:44:08 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Flow 'volume_create_manager' (f61f5b48-c928-4689-b9fb-bdff22a20579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5914692-2551-44ea-a2ef-104ea4a9cb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5914692-2551-44ea-a2ef-104ea4a9cb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1983522604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7985179-ef60-4de7-9c0a-6d220b5b100c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c57414a744480ab66b228bc2e1a0d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:08Z,use_quota=True,user_id='397f3a9a4b2a4ed48f2f345a3b30d515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2782f52-3292-407c-a6ad-a03a171acf9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2782f52-3292-407c-a6ad-a03a171acf9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e3f0de6-e6c3-4af5-9579-76d58616d368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e3f0de6-e6c3-4af5-9579-76d58616d368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7985179-ef60-4de7-9c0a-6d220b5b100c', 'volume_name': 'volume-e7985179-ef60-4de7-9c0a-6d220b5b100c', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4021998-08bb-4787-b94a-e1738d86f3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4021998-08bb-4787-b94a-e1738d86f3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b72bae8f-5c1d-49b1-81d4-79e437ad01c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:08 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Volume e7985179-ef60-4de7-9c0a-6d220b5b100c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7985179-ef60-4de7-9c0a-6d220b5b100c', 'volume_size': 1} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:08 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-70232198-b6e7-4876-9fff-c56fddb624ea" returned: 0 in 0.739s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.447s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1705965882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2df8d11f-634f-4390-85a0-b3e7dceaa8bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c57414a744480ab66b228bc2e1a0d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:07Z,use_quota=True,user_id='397f3a9a4b2a4ed48f2f345a3b30d515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Creating volume 2df8d11f-634f-4390-85a0-b3e7dceaa8bd {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:44:08 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2df8d11f-634f-4390-85a0-b3e7dceaa8bd 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69ec13ee-b501-41de-9cb2-a40acc2b0347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70232198-b6e7-4876-9fff-c56fddb624ea', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32cf9d66-b2b8-4bd6-843a-d38278ea5cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:08 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2df8d11f-634f-4390-85a0-b3e7dceaa8bd 1073741824 Jul 10 00:44:08 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:09 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Volume volume-70232198-b6e7-4876-9fff-c56fddb624ea (70232198-b6e7-4876-9fff-c56fddb624ea): created successfully Jul 10 00:44:09 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32cf9d66-b2b8-4bd6-843a-d38278ea5cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:09 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Flow 'volume_create_manager' (cfdc813c-1871-45d0-bdf5-ef7ab933a505) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:09 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-21b30c2f-aa0c-421d-9568-56610a6aa70d tempest-CreateVolumesFromImageTest-1399977198 None] Created volume successfully. Jul 10 00:44:09 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2df8d11f-634f-4390-85a0-b3e7dceaa8bd 1073741824" returned: 0 in 0.865s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2df8d11f-634f-4390-85a0-b3e7dceaa8bd {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:09 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2df8d11f-634f-4390-85a0-b3e7dceaa8bd Jul 10 00:44:09 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:10 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2df8d11f-634f-4390-85a0-b3e7dceaa8bd" returned: 0 in 0.639s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:10 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:44:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.633s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:10 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-936864996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e5ab2a8-157f-4a12-8212-728305d578a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c57414a744480ab66b228bc2e1a0d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:08Z,use_quota=True,user_id='397f3a9a4b2a4ed48f2f345a3b30d515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:44:10 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Creating volume 9e5ab2a8-157f-4a12-8212-728305d578a5 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:44:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:10 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:10 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:10 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:44:10 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:44:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9e5ab2a8-157f-4a12-8212-728305d578a5 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:10 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9e5ab2a8-157f-4a12-8212-728305d578a5 1073741824 Jul 10 00:44:10 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:10 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df80bfd9-4563-493c-9511-58aa1e37778f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2df8d11f-634f-4390-85a0-b3e7dceaa8bd', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:10 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81608a56-65c4-4cac-9fb2-07456e083fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:10 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Volume volume-2df8d11f-634f-4390-85a0-b3e7dceaa8bd (2df8d11f-634f-4390-85a0-b3e7dceaa8bd): created successfully Jul 10 00:44:10 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81608a56-65c4-4cac-9fb2-07456e083fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:10 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Flow 'volume_create_manager' (b29922ba-eeaa-4051-a8e6-d4c87e8af978) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:10 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-03f17135-c350-41b2-963e-43c280df1904 tempest-CreateVolumesFromImageTest-1399977198 None] Created volume successfully. Jul 10 00:44:11 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9e5ab2a8-157f-4a12-8212-728305d578a5 1073741824" returned: 0 in 0.783s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9e5ab2a8-157f-4a12-8212-728305d578a5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:11 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9e5ab2a8-157f-4a12-8212-728305d578a5 Jul 10 00:44:11 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:12 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9e5ab2a8-157f-4a12-8212-728305d578a5" returned: 0 in 0.677s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:12 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:44:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.806s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:12 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-154409092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3deb26c2-18c1-43c3-81f5-47e601f91811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c57414a744480ab66b228bc2e1a0d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:08Z,use_quota=True,user_id='397f3a9a4b2a4ed48f2f345a3b30d515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:44:12 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Creating volume 3deb26c2-18c1-43c3-81f5-47e601f91811 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:44:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:12 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:12 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:12 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:44:12 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:44:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3deb26c2-18c1-43c3-81f5-47e601f91811 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f92b13-2be6-483e-b6bc-64a470dad49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e5ab2a8-157f-4a12-8212-728305d578a5', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:12 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3deb26c2-18c1-43c3-81f5-47e601f91811 1073741824 Jul 10 00:44:12 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8a438d-d758-4ba7-a4cc-5c4ebb4776f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:12 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Volume volume-9e5ab2a8-157f-4a12-8212-728305d578a5 (9e5ab2a8-157f-4a12-8212-728305d578a5): created successfully Jul 10 00:44:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8a438d-d758-4ba7-a4cc-5c4ebb4776f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:12 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Flow 'volume_create_manager' (dab618a6-07da-4bfd-88ba-d1fc42484d70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:12 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-e90d6ba0-cf4d-4282-a411-d4a02153c462 tempest-CreateVolumesFromImageTest-1399977198 None] Created volume successfully. Jul 10 00:44:12 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3deb26c2-18c1-43c3-81f5-47e601f91811 1073741824" returned: 0 in 0.831s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3deb26c2-18c1-43c3-81f5-47e601f91811 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:12 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3deb26c2-18c1-43c3-81f5-47e601f91811 Jul 10 00:44:12 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:13 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3deb26c2-18c1-43c3-81f5-47e601f91811" returned: 0 in 0.629s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:44:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.892s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1983522604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7985179-ef60-4de7-9c0a-6d220b5b100c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03c57414a744480ab66b228bc2e1a0d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:08Z,use_quota=True,user_id='397f3a9a4b2a4ed48f2f345a3b30d515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:44:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Creating volume e7985179-ef60-4de7-9c0a-6d220b5b100c {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:44:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:44:13 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:44:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e7985179-ef60-4de7-9c0a-6d220b5b100c 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da5a8ece-ab4c-44f8-be24-105fadd7652b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3deb26c2-18c1-43c3-81f5-47e601f91811', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:13 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e7985179-ef60-4de7-9c0a-6d220b5b100c 1073741824 Jul 10 00:44:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bacf4b1e-7007-4b5c-9350-4a3a7b434817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:13 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:13 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Volume volume-3deb26c2-18c1-43c3-81f5-47e601f91811 (3deb26c2-18c1-43c3-81f5-47e601f91811): created successfully Jul 10 00:44:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bacf4b1e-7007-4b5c-9350-4a3a7b434817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Flow 'volume_create_manager' (97051eda-1da3-48ab-a1d5-f69569eaae4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:13 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-e57efed9-59f1-41d3-a720-b4578e18e115 tempest-CreateVolumesFromImageTest-1399977198 None] Created volume successfully. Jul 10 00:44:14 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e7985179-ef60-4de7-9c0a-6d220b5b100c 1073741824" returned: 0 in 0.816s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e7985179-ef60-4de7-9c0a-6d220b5b100c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:14 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e7985179-ef60-4de7-9c0a-6d220b5b100c Jul 10 00:44:14 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:15 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e7985179-ef60-4de7-9c0a-6d220b5b100c" returned: 0 in 0.671s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:15 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:44:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:15 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b72bae8f-5c1d-49b1-81d4-79e437ad01c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7985179-ef60-4de7-9c0a-6d220b5b100c', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:15 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (890c1a8d-f694-4fb6-a498-82cc9dfd287d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:15 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Volume volume-e7985179-ef60-4de7-9c0a-6d220b5b100c (e7985179-ef60-4de7-9c0a-6d220b5b100c): created successfully Jul 10 00:44:15 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (890c1a8d-f694-4fb6-a498-82cc9dfd287d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:15 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Flow 'volume_create_manager' (f61f5b48-c928-4689-b9fb-bdff22a20579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:15 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-aeba8e1b-6fb3-4ca8-9b24-f64c126be07a tempest-CreateVolumesFromImageTest-1399977198 None] Created volume successfully. Jul 10 00:44:16 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b733aa26-7ba0-4507-847d-bfa5b9af43f1 tempest-CreateVolumesFromImageTest-1399977198 None] Acquiring lock "cinder-e7985179-ef60-4de7-9c0a-6d220b5b100c-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:16 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b733aa26-7ba0-4507-847d-bfa5b9af43f1 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "cinder-e7985179-ef60-4de7-9c0a-6d220b5b100c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:16 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b733aa26-7ba0-4507-847d-bfa5b9af43f1 tempest-CreateVolumesFromImageTest-1399977198 None] Acquiring lock "cinder-quobyte-e7985179-ef60-4de7-9c0a-6d220b5b100c" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:16 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b733aa26-7ba0-4507-847d-bfa5b9af43f1 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "cinder-quobyte-e7985179-ef60-4de7-9c0a-6d220b5b100c" acquired by "delete_volume" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:16 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[753fcb2d-7d34-4da6-a941-d8b56340fca1]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:44:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b733aa26-7ba0-4507-847d-bfa5b9af43f1 tempest-CreateVolumesFromImageTest-1399977198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e7985179-ef60-4de7-9c0a-6d220b5b100c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:16 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e7985179-ef60-4de7-9c0a-6d220b5b100c Jul 10 00:44:16 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:17 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b733aa26-7ba0-4507-847d-bfa5b9af43f1 tempest-CreateVolumesFromImageTest-1399977198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e7985179-ef60-4de7-9c0a-6d220b5b100c" returned: 0 in 0.776s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b733aa26-7ba0-4507-847d-bfa5b9af43f1 tempest-CreateVolumesFromImageTest-1399977198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e7985179-ef60-4de7-9c0a-6d220b5b100c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:17 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e7985179-ef60-4de7-9c0a-6d220b5b100c Jul 10 00:44:17 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:17 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b733aa26-7ba0-4507-847d-bfa5b9af43f1 tempest-CreateVolumesFromImageTest-1399977198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e7985179-ef60-4de7-9c0a-6d220b5b100c" returned: 0 in 0.614s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:17 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b733aa26-7ba0-4507-847d-bfa5b9af43f1 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "cinder-quobyte-e7985179-ef60-4de7-9c0a-6d220b5b100c" released by "delete_volume" :: held 1.429s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:17 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-b733aa26-7ba0-4507-847d-bfa5b9af43f1 tempest-CreateVolumesFromImageTest-1399977198 None] Created reservations ['ed598e7f-4ec1-42d3-97b2-fa2be3e4330d', '802ec345-5133-4e3a-a118-67a450952fec', '8467b03e-a0a2-4060-9397-ee202f12fcb0', '2fec457e-7216-4464-8fab-aeb009a3b8b7'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:44:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b733aa26-7ba0-4507-847d-bfa5b9af43f1 tempest-CreateVolumesFromImageTest-1399977198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b733aa26-7ba0-4507-847d-bfa5b9af43f1 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b733aa26-7ba0-4507-847d-bfa5b9af43f1 tempest-CreateVolumesFromImageTest-1399977198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b733aa26-7ba0-4507-847d-bfa5b9af43f1 tempest-CreateVolumesFromImageTest-1399977198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b733aa26-7ba0-4507-847d-bfa5b9af43f1 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b733aa26-7ba0-4507-847d-bfa5b9af43f1 tempest-CreateVolumesFromImageTest-1399977198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:17 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:44:17 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:18 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b733aa26-7ba0-4507-847d-bfa5b9af43f1 tempest-CreateVolumesFromImageTest-1399977198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.608s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:18 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-b733aa26-7ba0-4507-847d-bfa5b9af43f1 tempest-CreateVolumesFromImageTest-1399977198 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:44:18 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-9bf21b75-ab8b-4d1e-9fb9-e46c939f5555 tempest-CreateVolumesFromImageTest-1399977198 None] Acquiring lock "cinder-3deb26c2-18c1-43c3-81f5-47e601f91811-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:18 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-b733aa26-7ba0-4507-847d-bfa5b9af43f1 tempest-CreateVolumesFromImageTest-1399977198 None] Deleted volume successfully. Jul 10 00:44:18 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-9bf21b75-ab8b-4d1e-9fb9-e46c939f5555 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "cinder-3deb26c2-18c1-43c3-81f5-47e601f91811-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:18 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b733aa26-7ba0-4507-847d-bfa5b9af43f1 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "cinder-e7985179-ef60-4de7-9c0a-6d220b5b100c-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:18 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-9bf21b75-ab8b-4d1e-9fb9-e46c939f5555 tempest-CreateVolumesFromImageTest-1399977198 None] Acquiring lock "cinder-quobyte-3deb26c2-18c1-43c3-81f5-47e601f91811" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:18 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-9bf21b75-ab8b-4d1e-9fb9-e46c939f5555 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "cinder-quobyte-3deb26c2-18c1-43c3-81f5-47e601f91811" acquired by "delete_volume" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:18 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0bac70-549a-42de-a2d6-52dca5ea37de]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:44:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9bf21b75-ab8b-4d1e-9fb9-e46c939f5555 tempest-CreateVolumesFromImageTest-1399977198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3deb26c2-18c1-43c3-81f5-47e601f91811 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:18 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3deb26c2-18c1-43c3-81f5-47e601f91811 Jul 10 00:44:18 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:19 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9bf21b75-ab8b-4d1e-9fb9-e46c939f5555 tempest-CreateVolumesFromImageTest-1399977198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3deb26c2-18c1-43c3-81f5-47e601f91811" returned: 0 in 0.799s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9bf21b75-ab8b-4d1e-9fb9-e46c939f5555 tempest-CreateVolumesFromImageTest-1399977198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3deb26c2-18c1-43c3-81f5-47e601f91811 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:19 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3deb26c2-18c1-43c3-81f5-47e601f91811 Jul 10 00:44:19 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:19 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9bf21b75-ab8b-4d1e-9fb9-e46c939f5555 tempest-CreateVolumesFromImageTest-1399977198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-3deb26c2-18c1-43c3-81f5-47e601f91811" returned: 0 in 0.623s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:19 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-9bf21b75-ab8b-4d1e-9fb9-e46c939f5555 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "cinder-quobyte-3deb26c2-18c1-43c3-81f5-47e601f91811" released by "delete_volume" :: held 1.459s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:19 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-9bf21b75-ab8b-4d1e-9fb9-e46c939f5555 tempest-CreateVolumesFromImageTest-1399977198 None] Created reservations ['5064934f-fae6-4a96-8ad8-b15f687509fd', 'a10468b6-4bff-4f80-9ab4-7ef516503e04', 'facedc9e-c9f4-444f-8571-51e00303f0e4', '21f8455f-372f-47a1-b3c2-0ff4ab03d439'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:44:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9bf21b75-ab8b-4d1e-9fb9-e46c939f5555 tempest-CreateVolumesFromImageTest-1399977198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9bf21b75-ab8b-4d1e-9fb9-e46c939f5555 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:20 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-9bf21b75-ab8b-4d1e-9fb9-e46c939f5555 tempest-CreateVolumesFromImageTest-1399977198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:20 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-9bf21b75-ab8b-4d1e-9fb9-e46c939f5555 tempest-CreateVolumesFromImageTest-1399977198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-9bf21b75-ab8b-4d1e-9fb9-e46c939f5555 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9bf21b75-ab8b-4d1e-9fb9-e46c939f5555 tempest-CreateVolumesFromImageTest-1399977198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:20 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:44:20 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e6984757-c03d-4395-86cc-6376d494ed4b tempest-CreateVolumesFromImageTest-1399977198 None] Acquiring lock "cinder-9e5ab2a8-157f-4a12-8212-728305d578a5-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e6984757-c03d-4395-86cc-6376d494ed4b tempest-CreateVolumesFromImageTest-1399977198 None] Lock "cinder-9e5ab2a8-157f-4a12-8212-728305d578a5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:20 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-9bf21b75-ab8b-4d1e-9fb9-e46c939f5555 tempest-CreateVolumesFromImageTest-1399977198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.634s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:20 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-9bf21b75-ab8b-4d1e-9fb9-e46c939f5555 tempest-CreateVolumesFromImageTest-1399977198 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:44:20 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-9bf21b75-ab8b-4d1e-9fb9-e46c939f5555 tempest-CreateVolumesFromImageTest-1399977198 None] Deleted volume successfully. Jul 10 00:44:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e6984757-c03d-4395-86cc-6376d494ed4b tempest-CreateVolumesFromImageTest-1399977198 None] Acquiring lock "cinder-quobyte-9e5ab2a8-157f-4a12-8212-728305d578a5" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e6984757-c03d-4395-86cc-6376d494ed4b tempest-CreateVolumesFromImageTest-1399977198 None] Lock "cinder-quobyte-9e5ab2a8-157f-4a12-8212-728305d578a5" acquired by "delete_volume" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-9bf21b75-ab8b-4d1e-9fb9-e46c939f5555 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "cinder-3deb26c2-18c1-43c3-81f5-47e601f91811-delete_volume" released by "delete_volume" :: held 2.286s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:20 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01b7798-66f9-4189-96f9-187e151c186b]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:44:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e6984757-c03d-4395-86cc-6376d494ed4b tempest-CreateVolumesFromImageTest-1399977198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9e5ab2a8-157f-4a12-8212-728305d578a5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:20 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9e5ab2a8-157f-4a12-8212-728305d578a5 Jul 10 00:44:20 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:21 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e6984757-c03d-4395-86cc-6376d494ed4b tempest-CreateVolumesFromImageTest-1399977198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9e5ab2a8-157f-4a12-8212-728305d578a5" returned: 0 in 0.707s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e6984757-c03d-4395-86cc-6376d494ed4b tempest-CreateVolumesFromImageTest-1399977198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9e5ab2a8-157f-4a12-8212-728305d578a5 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:21 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9e5ab2a8-157f-4a12-8212-728305d578a5 Jul 10 00:44:21 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:22 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e6984757-c03d-4395-86cc-6376d494ed4b tempest-CreateVolumesFromImageTest-1399977198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9e5ab2a8-157f-4a12-8212-728305d578a5" returned: 0 in 0.618s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:22 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e6984757-c03d-4395-86cc-6376d494ed4b tempest-CreateVolumesFromImageTest-1399977198 None] Lock "cinder-quobyte-9e5ab2a8-157f-4a12-8212-728305d578a5" released by "delete_volume" :: held 1.361s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:22 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-e6984757-c03d-4395-86cc-6376d494ed4b tempest-CreateVolumesFromImageTest-1399977198 None] Created reservations ['b80ccb87-a388-4c29-afb2-eb0b92d30e92', 'cb8077ca-8f04-4f8b-a50b-971ef02d2d13', 'cee276b2-501e-4067-9e24-dc525c767534', 'e5d2067a-151c-4950-b855-66b5def680f9'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:44:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e6984757-c03d-4395-86cc-6376d494ed4b tempest-CreateVolumesFromImageTest-1399977198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e6984757-c03d-4395-86cc-6376d494ed4b tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:22 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e6984757-c03d-4395-86cc-6376d494ed4b tempest-CreateVolumesFromImageTest-1399977198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:22 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e6984757-c03d-4395-86cc-6376d494ed4b tempest-CreateVolumesFromImageTest-1399977198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e6984757-c03d-4395-86cc-6376d494ed4b tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e6984757-c03d-4395-86cc-6376d494ed4b tempest-CreateVolumesFromImageTest-1399977198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:22 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:44:22 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:22 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e6984757-c03d-4395-86cc-6376d494ed4b tempest-CreateVolumesFromImageTest-1399977198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.648s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:22 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-e6984757-c03d-4395-86cc-6376d494ed4b tempest-CreateVolumesFromImageTest-1399977198 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:44:22 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-e6984757-c03d-4395-86cc-6376d494ed4b tempest-CreateVolumesFromImageTest-1399977198 None] Deleted volume successfully. Jul 10 00:44:22 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1656ef37-8511-48ee-a15a-8e7d1c3c8939 tempest-CreateVolumesFromImageTest-1399977198 None] Acquiring lock "cinder-2df8d11f-634f-4390-85a0-b3e7dceaa8bd-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:22 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e6984757-c03d-4395-86cc-6376d494ed4b tempest-CreateVolumesFromImageTest-1399977198 None] Lock "cinder-9e5ab2a8-157f-4a12-8212-728305d578a5-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:22 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1656ef37-8511-48ee-a15a-8e7d1c3c8939 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "cinder-2df8d11f-634f-4390-85a0-b3e7dceaa8bd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:22 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1656ef37-8511-48ee-a15a-8e7d1c3c8939 tempest-CreateVolumesFromImageTest-1399977198 None] Acquiring lock "cinder-quobyte-2df8d11f-634f-4390-85a0-b3e7dceaa8bd" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:22 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1656ef37-8511-48ee-a15a-8e7d1c3c8939 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "cinder-quobyte-2df8d11f-634f-4390-85a0-b3e7dceaa8bd" acquired by "delete_volume" :: waited 0.014s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:22 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a32c517-9850-4198-961e-c89166ae4055]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:44:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1656ef37-8511-48ee-a15a-8e7d1c3c8939 tempest-CreateVolumesFromImageTest-1399977198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2df8d11f-634f-4390-85a0-b3e7dceaa8bd {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:23 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2df8d11f-634f-4390-85a0-b3e7dceaa8bd Jul 10 00:44:23 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:23 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1656ef37-8511-48ee-a15a-8e7d1c3c8939 tempest-CreateVolumesFromImageTest-1399977198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2df8d11f-634f-4390-85a0-b3e7dceaa8bd" returned: 0 in 0.732s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1656ef37-8511-48ee-a15a-8e7d1c3c8939 tempest-CreateVolumesFromImageTest-1399977198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2df8d11f-634f-4390-85a0-b3e7dceaa8bd {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:23 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2df8d11f-634f-4390-85a0-b3e7dceaa8bd Jul 10 00:44:23 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:24 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1656ef37-8511-48ee-a15a-8e7d1c3c8939 tempest-CreateVolumesFromImageTest-1399977198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2df8d11f-634f-4390-85a0-b3e7dceaa8bd" returned: 0 in 0.610s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1656ef37-8511-48ee-a15a-8e7d1c3c8939 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "cinder-quobyte-2df8d11f-634f-4390-85a0-b3e7dceaa8bd" released by "delete_volume" :: held 1.380s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:24 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-1656ef37-8511-48ee-a15a-8e7d1c3c8939 tempest-CreateVolumesFromImageTest-1399977198 None] Created reservations ['e495acdc-f27c-49e3-9576-af36b8e943f0', '9fe9f381-19cb-4f81-a6d9-292ccedfc1dc', '3e00a384-41c0-4378-9cf0-f18b55aaea61', 'a3964f54-5a7d-496b-aa33-40add9789361'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:44:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1656ef37-8511-48ee-a15a-8e7d1c3c8939 tempest-CreateVolumesFromImageTest-1399977198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1656ef37-8511-48ee-a15a-8e7d1c3c8939 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1656ef37-8511-48ee-a15a-8e7d1c3c8939 tempest-CreateVolumesFromImageTest-1399977198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1656ef37-8511-48ee-a15a-8e7d1c3c8939 tempest-CreateVolumesFromImageTest-1399977198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1656ef37-8511-48ee-a15a-8e7d1c3c8939 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1656ef37-8511-48ee-a15a-8e7d1c3c8939 tempest-CreateVolumesFromImageTest-1399977198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:24 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:44:24 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:25 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1656ef37-8511-48ee-a15a-8e7d1c3c8939 tempest-CreateVolumesFromImageTest-1399977198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.612s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:25 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-1656ef37-8511-48ee-a15a-8e7d1c3c8939 tempest-CreateVolumesFromImageTest-1399977198 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:44:25 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-1656ef37-8511-48ee-a15a-8e7d1c3c8939 tempest-CreateVolumesFromImageTest-1399977198 None] Deleted volume successfully. Jul 10 00:44:25 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-65108ccb-34e3-4b80-bd91-af64bfa56185 tempest-CreateVolumesFromImageTest-1399977198 None] Acquiring lock "cinder-70232198-b6e7-4876-9fff-c56fddb624ea-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:25 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-1656ef37-8511-48ee-a15a-8e7d1c3c8939 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "cinder-2df8d11f-634f-4390-85a0-b3e7dceaa8bd-delete_volume" released by "delete_volume" :: held 2.190s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:25 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-65108ccb-34e3-4b80-bd91-af64bfa56185 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "cinder-70232198-b6e7-4876-9fff-c56fddb624ea-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:25 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-65108ccb-34e3-4b80-bd91-af64bfa56185 tempest-CreateVolumesFromImageTest-1399977198 None] Acquiring lock "cinder-quobyte-70232198-b6e7-4876-9fff-c56fddb624ea" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:25 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-65108ccb-34e3-4b80-bd91-af64bfa56185 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "cinder-quobyte-70232198-b6e7-4876-9fff-c56fddb624ea" acquired by "delete_volume" :: waited 0.013s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:25 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[11181319-4143-472f-9304-ea4390e1f4c9]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:44:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-65108ccb-34e3-4b80-bd91-af64bfa56185 tempest-CreateVolumesFromImageTest-1399977198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-70232198-b6e7-4876-9fff-c56fddb624ea {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:25 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-70232198-b6e7-4876-9fff-c56fddb624ea Jul 10 00:44:25 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:25 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-65108ccb-34e3-4b80-bd91-af64bfa56185 tempest-CreateVolumesFromImageTest-1399977198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-70232198-b6e7-4876-9fff-c56fddb624ea" returned: 0 in 0.718s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-65108ccb-34e3-4b80-bd91-af64bfa56185 tempest-CreateVolumesFromImageTest-1399977198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-70232198-b6e7-4876-9fff-c56fddb624ea {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:25 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-70232198-b6e7-4876-9fff-c56fddb624ea Jul 10 00:44:25 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:26 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-65108ccb-34e3-4b80-bd91-af64bfa56185 tempest-CreateVolumesFromImageTest-1399977198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-70232198-b6e7-4876-9fff-c56fddb624ea" returned: 0 in 0.603s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-65108ccb-34e3-4b80-bd91-af64bfa56185 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "cinder-quobyte-70232198-b6e7-4876-9fff-c56fddb624ea" released by "delete_volume" :: held 1.356s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:26 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-65108ccb-34e3-4b80-bd91-af64bfa56185 tempest-CreateVolumesFromImageTest-1399977198 None] Created reservations ['74b36324-1330-437a-8b26-acf84a87c12c', '783d3732-f425-43eb-9d25-155f94eaf312', '0838069f-df0b-43af-8a92-1da3a2b91b5b', '9f1eeb4d-7904-4e52-9fff-dd8c94383244'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:44:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-65108ccb-34e3-4b80-bd91-af64bfa56185 tempest-CreateVolumesFromImageTest-1399977198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-65108ccb-34e3-4b80-bd91-af64bfa56185 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-65108ccb-34e3-4b80-bd91-af64bfa56185 tempest-CreateVolumesFromImageTest-1399977198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-65108ccb-34e3-4b80-bd91-af64bfa56185 tempest-CreateVolumesFromImageTest-1399977198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-65108ccb-34e3-4b80-bd91-af64bfa56185 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-65108ccb-34e3-4b80-bd91-af64bfa56185 tempest-CreateVolumesFromImageTest-1399977198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:26 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:44:26 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:27 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-65108ccb-34e3-4b80-bd91-af64bfa56185 tempest-CreateVolumesFromImageTest-1399977198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.611s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:27 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-65108ccb-34e3-4b80-bd91-af64bfa56185 tempest-CreateVolumesFromImageTest-1399977198 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:44:27 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-65108ccb-34e3-4b80-bd91-af64bfa56185 tempest-CreateVolumesFromImageTest-1399977198 None] Deleted volume successfully. Jul 10 00:44:27 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-65108ccb-34e3-4b80-bd91-af64bfa56185 tempest-CreateVolumesFromImageTest-1399977198 None] Lock "cinder-70232198-b6e7-4876-9fff-c56fddb624ea-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:44:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:44:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:31 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:44:31 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:32 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.633s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:32 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:44:32 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:44:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 29 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:44:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:44:36 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=49,cinder:UPDATE=80,cinder:INSERT=16,cinder:DELETE=6 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:44:37 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=38,cinder:UPDATE=54,cinder:DELETE=6,cinder:INSERT=14 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:44:46 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:44:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Flow 'volume_create_manager' (a8d33c9b-0c22-472f-a530-6b1ec1ea835d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69679949-1406-42a4-aa8f-0789f8322edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69679949-1406-42a4-aa8f-0789f8322edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-862071985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa26bbb2-c79d-4ef1-bb7f-46b406e4840a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93504e15a932425ba7882ba170ac6bbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:46Z,use_quota=True,user_id='d90774c9320b4758ab40d7e56d341f5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ccaa139-73c2-423b-b404-44d34542e4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ccaa139-73c2-423b-b404-44d34542e4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e17664b-21ec-4cf3-bf1c-82436ad66e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e17664b-21ec-4cf3-bf1c-82436ad66e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa26bbb2-c79d-4ef1-bb7f-46b406e4840a', 'volume_name': 'volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (266e4408-ca2b-4d7f-ab11-fe9aaad09901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (266e4408-ca2b-4d7f-ab11-fe9aaad09901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7969676-e210-46b4-add3-008c45d98d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:46 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Volume aa26bbb2-c79d-4ef1-bb7f-46b406e4840a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a', 'volume_size': 1} Jul 10 00:44:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:46 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-862071985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa26bbb2-c79d-4ef1-bb7f-46b406e4840a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93504e15a932425ba7882ba170ac6bbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:46Z,use_quota=True,user_id='d90774c9320b4758ab40d7e56d341f5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:44:46 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Creating volume aa26bbb2-c79d-4ef1-bb7f-46b406e4840a {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:44:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:46 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:46 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:46 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:44:46 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:44:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:46 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a 1073741824 Jul 10 00:44:46 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:47 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a 1073741824" returned: 0 in 0.778s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:47 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a Jul 10 00:44:47 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:47 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a" returned: 0 in 0.641s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:44:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7969676-e210-46b4-add3-008c45d98d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d19716aa-d48d-40b8-a796-f146f0c14985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:47 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Volume volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a (aa26bbb2-c79d-4ef1-bb7f-46b406e4840a): created successfully Jul 10 00:44:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d19716aa-d48d-40b8-a796-f146f0c14985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Flow 'volume_create_manager' (a8d33c9b-0c22-472f-a530-6b1ec1ea835d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:47 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-dbebed3d-3e59-4993-b9e7-0fbf9e985c34 tempest-SnapshotDependencyTests-1759571732 None] Created volume successfully. Jul 10 00:44:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d085e54f-4293-4ac0-bae0-744fd5edcbe1 tempest-SnapshotDependencyTests-1759571732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d085e54f-4293-4ac0-bae0-744fd5edcbe1 tempest-SnapshotDependencyTests-1759571732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-d085e54f-4293-4ac0-bae0-744fd5edcbe1 tempest-SnapshotDependencyTests-1759571732 None] Creating offline snapshot 8e4e54ab-67b4-480f-8b09-08b993dc5430 of volume aa26bbb2-c79d-4ef1-bb7f-46b406e4840a {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:44:48 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa301dc9-d87f-4138-a540-4dd36d84ff20]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:44:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d085e54f-4293-4ac0-bae0-744fd5edcbe1 tempest-SnapshotDependencyTests-1759571732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:48 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a Jul 10 00:44:48 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:49 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d085e54f-4293-4ac0-bae0-744fd5edcbe1 tempest-SnapshotDependencyTests-1759571732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a" returned: 0 in 0.703s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d085e54f-4293-4ac0-bae0-744fd5edcbe1 tempest-SnapshotDependencyTests-1759571732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.8e4e54ab-67b4-480f-8b09-08b993dc5430 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:49 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.8e4e54ab-67b4-480f-8b09-08b993dc5430 1G Jul 10 00:44:49 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:50 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d085e54f-4293-4ac0-bae0-744fd5edcbe1 tempest-SnapshotDependencyTests-1759571732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.8e4e54ab-67b4-480f-8b09-08b993dc5430 1G" returned: 0 in 0.749s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d085e54f-4293-4ac0-bae0-744fd5edcbe1 tempest-SnapshotDependencyTests-1759571732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.8e4e54ab-67b4-480f-8b09-08b993dc5430 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:50 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.8e4e54ab-67b4-480f-8b09-08b993dc5430 Jul 10 00:44:50 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:50 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d085e54f-4293-4ac0-bae0-744fd5edcbe1 tempest-SnapshotDependencyTests-1759571732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.8e4e54ab-67b4-480f-8b09-08b993dc5430" returned: 0 in 0.660s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:50 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-d085e54f-4293-4ac0-bae0-744fd5edcbe1 tempest-SnapshotDependencyTests-1759571732 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.8e4e54ab-67b4-480f-8b09-08b993dc5430 is being set with open permissions: ugo+rw Jul 10 00:44:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d085e54f-4293-4ac0-bae0-744fd5edcbe1 tempest-SnapshotDependencyTests-1759571732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.8e4e54ab-67b4-480f-8b09-08b993dc5430 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:50 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.8e4e54ab-67b4-480f-8b09-08b993dc5430 Jul 10 00:44:50 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:51 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d085e54f-4293-4ac0-bae0-744fd5edcbe1 tempest-SnapshotDependencyTests-1759571732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.8e4e54ab-67b4-480f-8b09-08b993dc5430" returned: 0 in 0.598s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d085e54f-4293-4ac0-bae0-744fd5edcbe1 tempest-SnapshotDependencyTests-1759571732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:51 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.info Jul 10 00:44:51 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:51 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d085e54f-4293-4ac0-bae0-744fd5edcbe1 tempest-SnapshotDependencyTests-1759571732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.info" returned: 0 in 0.611s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:51 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-d085e54f-4293-4ac0-bae0-744fd5edcbe1 tempest-SnapshotDependencyTests-1759571732 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.info is being set with open permissions: ugo+rw Jul 10 00:44:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d085e54f-4293-4ac0-bae0-744fd5edcbe1 tempest-SnapshotDependencyTests-1759571732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:51 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.info Jul 10 00:44:51 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:52 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d085e54f-4293-4ac0-bae0-744fd5edcbe1 tempest-SnapshotDependencyTests-1759571732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.info" returned: 0 in 0.599s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d085e54f-4293-4ac0-bae0-744fd5edcbe1 tempest-SnapshotDependencyTests-1759571732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:52 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-d085e54f-4293-4ac0-bae0-744fd5edcbe1 tempest-SnapshotDependencyTests-1759571732 None] Create snapshot completed successfully Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Flow 'volume_create_manager' (b2e261bc-7123-418e-85c1-6c52a33d6eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608ed144-8981-41af-a6a8-fd05a402429c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608ed144-8981-41af-a6a8-fd05a402429c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74246440-90fe-46c7-a808-e61fbcd6a9d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93504e15a932425ba7882ba170ac6bbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8e4e54ab-67b4-480f-8b09-08b993dc5430,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:44:53Z,use_quota=True,user_id='d90774c9320b4758ab40d7e56d341f5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54911e9-6b36-4f71-93e0-d2c91c987f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54911e9-6b36-4f71-93e0-d2c91c987f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c69d2c85-b36d-4e82-8da0-b7636f483955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c69d2c85-b36d-4e82-8da0-b7636f483955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '74246440-90fe-46c7-a808-e61fbcd6a9d9', 'volume_name': 'volume-74246440-90fe-46c7-a808-e61fbcd6a9d9', 'volume_size': 1, 'snapshot_id': '8e4e54ab-67b4-480f-8b09-08b993dc5430'}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57429928-941c-4279-9847-e68e1c515e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57429928-941c-4279-9847-e68e1c515e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ebbf59-b8dc-4cbe-a9f4-f88a87e5af89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:44:53 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Volume 74246440-90fe-46c7-a808-e61fbcd6a9d9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-74246440-90fe-46c7-a808-e61fbcd6a9d9', 'volume_size': 1, 'snapshot_id': '8e4e54ab-67b4-480f-8b09-08b993dc5430'} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Acquiring lock "cinder-quobyte-8e4e54ab-67b4-480f-8b09-08b993dc5430-74246440-90fe-46c7-a808-e61fbcd6a9d9" by "_create_volume_from_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Lock "cinder-quobyte-8e4e54ab-67b4-480f-8b09-08b993dc5430-74246440-90fe-46c7-a808-e61fbcd6a9d9" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Creating volume 74246440-90fe-46c7-a808-e61fbcd6a9d9 from snapshot 8e4e54ab-67b4-480f-8b09-08b993dc5430 {{(pid=88119) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Acquiring lock "cinder-quobyte-74246440-90fe-46c7-a808-e61fbcd6a9d9" by "_copy_volume_from_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Lock "cinder-quobyte-74246440-90fe-46c7-a808-e61fbcd6a9d9" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] snapshot: 8e4e54ab-67b4-480f-8b09-08b993dc5430, volume: 74246440-90fe-46c7-a808-e61fbcd6a9d9, {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff3de29-b144-4d11-a904-c308d60e8d32]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:44:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.8e4e54ab-67b4-480f-8b09-08b993dc5430 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:53 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.8e4e54ab-67b4-480f-8b09-08b993dc5430 Jul 10 00:44:53 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:54 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.8e4e54ab-67b4-480f-8b09-08b993dc5430" returned: 0 in 0.740s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:44:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 00:44:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Creating direct copy from snapshot {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 00:44:54 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7132fa4-c9f6-4447-a378-beb0acc83d82]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:44:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:54 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a Jul 10 00:44:54 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:55 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a" returned: 0 in 0.742s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:55 devstack cinder-volume[88119]: DEBUG cinder.utils [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Path /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-74246440-90fe-46c7-a808-e61fbcd6a9d9 not found in is_blk_device check {{(pid=88119) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 00:44:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-74246440-90fe-46c7-a808-e61fbcd6a9d9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:55 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-74246440-90fe-46c7-a808-e61fbcd6a9d9 Jul 10 00:44:55 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:59 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-74246440-90fe-46c7-a808-e61fbcd6a9d9" returned: 0 in 4.057s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:59 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d45663-aaed-488d-8d5d-a33dc3f90859]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:44:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:44:59 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a Jul 10 00:44:59 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:44:59 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jul 10 00:44:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a" returned: 0 in 0.908s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:44:59 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Image conversion details: src /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a, size 1024.00 MB, duration 4.06 sec, destination /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-74246440-90fe-46c7-a808-e61fbcd6a9d9 {{(pid=88119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:44:59 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Converted 1024.00 MB image at 252.32 MB/s Jul 10 00:44:59 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-74246440-90fe-46c7-a808-e61fbcd6a9d9 is being set with open permissions: ugo+rw Jul 10 00:44:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-74246440-90fe-46c7-a808-e61fbcd6a9d9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:00 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-74246440-90fe-46c7-a808-e61fbcd6a9d9 Jul 10 00:45:00 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:00 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-74246440-90fe-46c7-a808-e61fbcd6a9d9" returned: 0 in 0.603s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Lock "cinder-quobyte-74246440-90fe-46c7-a808-e61fbcd6a9d9" released by "_copy_volume_from_snapshot" :: held 7.141s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Lock "cinder-quobyte-8e4e54ab-67b4-480f-8b09-08b993dc5430-74246440-90fe-46c7-a808-e61fbcd6a9d9" released by "_create_volume_from_snapshot" :: held 7.172s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.186s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5ebbf59-b8dc-4cbe-a9f4-f88a87e5af89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74246440-90fe-46c7-a808-e61fbcd6a9d9', 'volume_size': 1, 'snapshot_id': '8e4e54ab-67b4-480f-8b09-08b993dc5430'}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a357a33f-3efa-4c61-a313-a3d9a36e29b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:00 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Volume volume-74246440-90fe-46c7-a808-e61fbcd6a9d9 (74246440-90fe-46c7-a808-e61fbcd6a9d9): created successfully Jul 10 00:45:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a357a33f-3efa-4c61-a313-a3d9a36e29b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Flow 'volume_create_manager' (b2e261bc-7123-418e-85c1-6c52a33d6eec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:00 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-05f33b65-3cf5-4daa-802e-4e83f583c7ee tempest-SnapshotDependencyTests-1759571732 None] Created volume successfully. Jul 10 00:45:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-06b63a29-54af-475b-a553-9329adafc51e tempest-SnapshotDependencyTests-1759571732 None] Acquiring lock "cinder-8e4e54ab-67b4-480f-8b09-08b993dc5430-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-06b63a29-54af-475b-a553-9329adafc51e tempest-SnapshotDependencyTests-1759571732 None] Lock "cinder-8e4e54ab-67b4-480f-8b09-08b993dc5430-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-06b63a29-54af-475b-a553-9329adafc51e tempest-SnapshotDependencyTests-1759571732 None] Acquiring lock "cinder-quobyte-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-06b63a29-54af-475b-a553-9329adafc51e tempest-SnapshotDependencyTests-1759571732 None] Lock "cinder-quobyte-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-06b63a29-54af-475b-a553-9329adafc51e tempest-SnapshotDependencyTests-1759571732 None] Acquiring lock "cinder-quobyte-8e4e54ab-67b4-480f-8b09-08b993dc5430" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-06b63a29-54af-475b-a553-9329adafc51e tempest-SnapshotDependencyTests-1759571732 None] Lock "cinder-quobyte-8e4e54ab-67b4-480f-8b09-08b993dc5430" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-06b63a29-54af-475b-a553-9329adafc51e tempest-SnapshotDependencyTests-1759571732 None] Deleting offline snapshot 8e4e54ab-67b4-480f-8b09-08b993dc5430 of volume aa26bbb2-c79d-4ef1-bb7f-46b406e4840a {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:45:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-06b63a29-54af-475b-a553-9329adafc51e tempest-SnapshotDependencyTests-1759571732 None] snapshot_file for this snap is: volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.8e4e54ab-67b4-480f-8b09-08b993dc5430 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:45:00 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fc3fae-48a1-44f5-9802-01255d60b877]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-06b63a29-54af-475b-a553-9329adafc51e tempest-SnapshotDependencyTests-1759571732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.8e4e54ab-67b4-480f-8b09-08b993dc5430 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:01 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.8e4e54ab-67b4-480f-8b09-08b993dc5430 Jul 10 00:45:01 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:01 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-06b63a29-54af-475b-a553-9329adafc51e tempest-SnapshotDependencyTests-1759571732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.8e4e54ab-67b4-480f-8b09-08b993dc5430" returned: 0 in 0.716s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:01 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-06b63a29-54af-475b-a553-9329adafc51e tempest-SnapshotDependencyTests-1759571732 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:45:01 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa45447-168d-437d-98b9-92adcc4af46d]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-06b63a29-54af-475b-a553-9329adafc51e tempest-SnapshotDependencyTests-1759571732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:01 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a Jul 10 00:45:01 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:02 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-06b63a29-54af-475b-a553-9329adafc51e tempest-SnapshotDependencyTests-1759571732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a" returned: 0 in 0.746s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-06b63a29-54af-475b-a553-9329adafc51e tempest-SnapshotDependencyTests-1759571732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.8e4e54ab-67b4-480f-8b09-08b993dc5430 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:02 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.8e4e54ab-67b4-480f-8b09-08b993dc5430 Jul 10 00:45:02 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:03 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-06b63a29-54af-475b-a553-9329adafc51e tempest-SnapshotDependencyTests-1759571732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.8e4e54ab-67b4-480f-8b09-08b993dc5430" returned: 0 in 0.694s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-06b63a29-54af-475b-a553-9329adafc51e tempest-SnapshotDependencyTests-1759571732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.8e4e54ab-67b4-480f-8b09-08b993dc5430 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:03 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.8e4e54ab-67b4-480f-8b09-08b993dc5430 Jul 10 00:45:03 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:03 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-06b63a29-54af-475b-a553-9329adafc51e tempest-SnapshotDependencyTests-1759571732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a.8e4e54ab-67b4-480f-8b09-08b993dc5430" returned: 0 in 0.624s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:03 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-06b63a29-54af-475b-a553-9329adafc51e tempest-SnapshotDependencyTests-1759571732 None] Lock "cinder-quobyte-8e4e54ab-67b4-480f-8b09-08b993dc5430" released by "_delete_snapshot" :: held 2.870s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:03 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-06b63a29-54af-475b-a553-9329adafc51e tempest-SnapshotDependencyTests-1759571732 None] Lock "cinder-quobyte-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a" released by "delete_snapshot" :: held 2.891s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:03 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-06b63a29-54af-475b-a553-9329adafc51e tempest-SnapshotDependencyTests-1759571732 None] Created reservations ['55f0d942-635d-4594-88f6-b280133dea4a', '2a01ee43-2862-4c3e-8a75-42b3a9a4552b', '3f9fafc4-3aa6-4004-8660-69ac514ced65', 'e9330eef-01c0-4d3b-9d97-04942b64aaae'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:45:03 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-06b63a29-54af-475b-a553-9329adafc51e tempest-SnapshotDependencyTests-1759571732 None] Delete snapshot completed successfully. Jul 10 00:45:03 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-06b63a29-54af-475b-a553-9329adafc51e tempest-SnapshotDependencyTests-1759571732 None] Lock "cinder-8e4e54ab-67b4-480f-8b09-08b993dc5430-delete_snapshot" released by "delete_snapshot" :: held 3.035s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d1d13cf6-1630-4b32-9f67-0602dc65adef tempest-SnapshotDependencyTests-1759571732 None] Acquiring lock "cinder-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d1d13cf6-1630-4b32-9f67-0602dc65adef tempest-SnapshotDependencyTests-1759571732 None] Lock "cinder-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d1d13cf6-1630-4b32-9f67-0602dc65adef tempest-SnapshotDependencyTests-1759571732 None] Acquiring lock "cinder-quobyte-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d1d13cf6-1630-4b32-9f67-0602dc65adef tempest-SnapshotDependencyTests-1759571732 None] Lock "cinder-quobyte-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a" acquired by "delete_volume" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:04 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17376e7-5155-416a-b5ca-41f5c045b777]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d1d13cf6-1630-4b32-9f67-0602dc65adef tempest-SnapshotDependencyTests-1759571732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:04 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a Jul 10 00:45:04 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:04 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d1d13cf6-1630-4b32-9f67-0602dc65adef tempest-SnapshotDependencyTests-1759571732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a" returned: 0 in 0.763s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d1d13cf6-1630-4b32-9f67-0602dc65adef tempest-SnapshotDependencyTests-1759571732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:04 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a Jul 10 00:45:04 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:05 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d1d13cf6-1630-4b32-9f67-0602dc65adef tempest-SnapshotDependencyTests-1759571732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a" returned: 0 in 0.676s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d1d13cf6-1630-4b32-9f67-0602dc65adef tempest-SnapshotDependencyTests-1759571732 None] Lock "cinder-quobyte-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a" released by "delete_volume" :: held 1.502s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:05 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-d1d13cf6-1630-4b32-9f67-0602dc65adef tempest-SnapshotDependencyTests-1759571732 None] Created reservations ['c07c6ec6-a4f4-4bab-ab52-c3f564f65a8a', '59821b15-87c0-49b9-b95c-07a00a7d5470', '147382ef-3625-4d0d-8bb4-166d7e39c5b0', '6549a128-16af-48d0-8eda-3cae7d2749ec'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:45:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d1d13cf6-1630-4b32-9f67-0602dc65adef tempest-SnapshotDependencyTests-1759571732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d1d13cf6-1630-4b32-9f67-0602dc65adef tempest-SnapshotDependencyTests-1759571732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d1d13cf6-1630-4b32-9f67-0602dc65adef tempest-SnapshotDependencyTests-1759571732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d1d13cf6-1630-4b32-9f67-0602dc65adef tempest-SnapshotDependencyTests-1759571732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d1d13cf6-1630-4b32-9f67-0602dc65adef tempest-SnapshotDependencyTests-1759571732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d1d13cf6-1630-4b32-9f67-0602dc65adef tempest-SnapshotDependencyTests-1759571732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:05 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:45:05 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:06 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-41d3c121-5f3a-4c42-ac81-ab87c7db1699 tempest-SnapshotDependencyTests-1759571732 None] Acquiring lock "cinder-74246440-90fe-46c7-a808-e61fbcd6a9d9-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:06 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-41d3c121-5f3a-4c42-ac81-ab87c7db1699 tempest-SnapshotDependencyTests-1759571732 None] Lock "cinder-74246440-90fe-46c7-a808-e61fbcd6a9d9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:06 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-41d3c121-5f3a-4c42-ac81-ab87c7db1699 tempest-SnapshotDependencyTests-1759571732 None] Acquiring lock "cinder-quobyte-74246440-90fe-46c7-a808-e61fbcd6a9d9" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:06 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-41d3c121-5f3a-4c42-ac81-ab87c7db1699 tempest-SnapshotDependencyTests-1759571732 None] Lock "cinder-quobyte-74246440-90fe-46c7-a808-e61fbcd6a9d9" acquired by "delete_volume" :: waited 0.021s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:06 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8094c99-8b30-463c-baa3-b44f0e8ba35f]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-41d3c121-5f3a-4c42-ac81-ab87c7db1699 tempest-SnapshotDependencyTests-1759571732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-74246440-90fe-46c7-a808-e61fbcd6a9d9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:06 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d1d13cf6-1630-4b32-9f67-0602dc65adef tempest-SnapshotDependencyTests-1759571732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.676s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:06 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-d1d13cf6-1630-4b32-9f67-0602dc65adef tempest-SnapshotDependencyTests-1759571732 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:45:06 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-d1d13cf6-1630-4b32-9f67-0602dc65adef tempest-SnapshotDependencyTests-1759571732 None] Deleted volume successfully. Jul 10 00:45:06 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d1d13cf6-1630-4b32-9f67-0602dc65adef tempest-SnapshotDependencyTests-1759571732 None] Lock "cinder-aa26bbb2-c79d-4ef1-bb7f-46b406e4840a-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:06 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-74246440-90fe-46c7-a808-e61fbcd6a9d9 Jul 10 00:45:06 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:07 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-41d3c121-5f3a-4c42-ac81-ab87c7db1699 tempest-SnapshotDependencyTests-1759571732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-74246440-90fe-46c7-a808-e61fbcd6a9d9" returned: 0 in 0.734s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-41d3c121-5f3a-4c42-ac81-ab87c7db1699 tempest-SnapshotDependencyTests-1759571732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-74246440-90fe-46c7-a808-e61fbcd6a9d9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:07 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-74246440-90fe-46c7-a808-e61fbcd6a9d9 Jul 10 00:45:07 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:07 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-41d3c121-5f3a-4c42-ac81-ab87c7db1699 tempest-SnapshotDependencyTests-1759571732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-74246440-90fe-46c7-a808-e61fbcd6a9d9" returned: 0 in 0.647s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-41d3c121-5f3a-4c42-ac81-ab87c7db1699 tempest-SnapshotDependencyTests-1759571732 None] Lock "cinder-quobyte-74246440-90fe-46c7-a808-e61fbcd6a9d9" released by "delete_volume" :: held 1.426s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:07 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-41d3c121-5f3a-4c42-ac81-ab87c7db1699 tempest-SnapshotDependencyTests-1759571732 None] Created reservations ['d520d74d-547d-4702-a685-f162104f1be1', '0284c7b4-7618-4db0-b885-7683532f9be3', 'e1df81ca-58c3-4bf4-aca9-79890b65448b', '6a1c54b5-f46c-4074-98de-61da36fff68c'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:45:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-41d3c121-5f3a-4c42-ac81-ab87c7db1699 tempest-SnapshotDependencyTests-1759571732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-41d3c121-5f3a-4c42-ac81-ab87c7db1699 tempest-SnapshotDependencyTests-1759571732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-41d3c121-5f3a-4c42-ac81-ab87c7db1699 tempest-SnapshotDependencyTests-1759571732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-41d3c121-5f3a-4c42-ac81-ab87c7db1699 tempest-SnapshotDependencyTests-1759571732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-41d3c121-5f3a-4c42-ac81-ab87c7db1699 tempest-SnapshotDependencyTests-1759571732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-41d3c121-5f3a-4c42-ac81-ab87c7db1699 tempest-SnapshotDependencyTests-1759571732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:07 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:45:07 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:08 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-41d3c121-5f3a-4c42-ac81-ab87c7db1699 tempest-SnapshotDependencyTests-1759571732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.644s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:08 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-41d3c121-5f3a-4c42-ac81-ab87c7db1699 tempest-SnapshotDependencyTests-1759571732 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:45:08 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-41d3c121-5f3a-4c42-ac81-ab87c7db1699 tempest-SnapshotDependencyTests-1759571732 None] Deleted volume successfully. Jul 10 00:45:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-41d3c121-5f3a-4c42-ac81-ab87c7db1699 tempest-SnapshotDependencyTests-1759571732 None] Lock "cinder-74246440-90fe-46c7-a808-e61fbcd6a9d9-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:17 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=26,cinder:UPDATE=29,cinder:DELETE=1,cinder:INSERT=8 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:45:18 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:UPDATE=27,cinder:SELECT=21,cinder:INSERT=6,cinder:DELETE=4 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Flow 'volume_create_manager' (58c2786f-bc01-4585-bb26-8b3a79c97ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71a32bb6-dc26-4508-835c-cd1da203cc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71a32bb6-dc26-4508-835c-cd1da203cc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1493122305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc7007d7-754e-43c0-83be-6553da2822a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443d3952114443f48efce025f4426fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:28Z,use_quota=True,user_id='80259720603b4b9db2bf0274551f0482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e84965a-165c-4309-971f-9c5b7aabf4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e84965a-165c-4309-971f-9c5b7aabf4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de239450-52ac-4c7f-8f01-dd4607811772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de239450-52ac-4c7f-8f01-dd4607811772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc7007d7-754e-43c0-83be-6553da2822a7', 'volume_name': 'volume-bc7007d7-754e-43c0-83be-6553da2822a7', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6889a9-278b-40f0-a8d7-54936cdcda6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6889a9-278b-40f0-a8d7-54936cdcda6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48105eee-3f6b-4a9d-b30e-6a001382953b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:28 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Volume bc7007d7-754e-43c0-83be-6553da2822a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc7007d7-754e-43c0-83be-6553da2822a7', 'volume_size': 1} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1493122305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc7007d7-754e-43c0-83be-6553da2822a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443d3952114443f48efce025f4426fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:28Z,use_quota=True,user_id='80259720603b4b9db2bf0274551f0482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Creating volume bc7007d7-754e-43c0-83be-6553da2822a7 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:45:28 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:45:28 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7 1073741824 Jul 10 00:45:28 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Flow 'volume_create_manager' (0d09db02-2760-4c22-8bde-056f3492b553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2efc50-ea15-4f17-8573-564202766eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2efc50-ea15-4f17-8573-564202766eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-715056039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d667c1e-f3b5-42d7-8529-5c9936a82a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826b2f7bb8364557a7dbe10d3f74162e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:28Z,use_quota=True,user_id='b39fae2a385141d8b07402cb66529ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4582ef61-f908-499f-b682-3bd45cb1c153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4582ef61-f908-499f-b682-3bd45cb1c153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80866a3d-460e-46d6-80c0-873053d8e030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80866a3d-460e-46d6-80c0-873053d8e030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d667c1e-f3b5-42d7-8529-5c9936a82a7d', 'volume_name': 'volume-5d667c1e-f3b5-42d7-8529-5c9936a82a7d', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43481204-b370-44d6-9c2c-b23738e03239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43481204-b370-44d6-9c2c-b23738e03239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08775e70-918e-4586-ab4d-da74a366ca2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:28 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Volume 5d667c1e-f3b5-42d7-8529-5c9936a82a7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d667c1e-f3b5-42d7-8529-5c9936a82a7d', 'volume_size': 1} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Flow 'volume_create_manager' (3ceb37dd-c2af-41ac-bb5e-d2ca8fb3f066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d1e9770-b1f5-4776-b154-55345b964c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d1e9770-b1f5-4776-b154-55345b964c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-445631689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16110339-6c50-416f-88dc-3ef246a4eb7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826b2f7bb8364557a7dbe10d3f74162e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:28Z,use_quota=True,user_id='b39fae2a385141d8b07402cb66529ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba204e2-1103-474b-9c5f-662a4b69c7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba204e2-1103-474b-9c5f-662a4b69c7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63bfe927-7100-4e34-bd3b-609eed2ff5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63bfe927-7100-4e34-bd3b-609eed2ff5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16110339-6c50-416f-88dc-3ef246a4eb7b', 'volume_name': 'volume-16110339-6c50-416f-88dc-3ef246a4eb7b', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61353bf6-916c-4627-b14c-409f1623d0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61353bf6-916c-4627-b14c-409f1623d0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (920a0894-f608-4183-abc9-467098526a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:28 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Volume 16110339-6c50-416f-88dc-3ef246a4eb7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16110339-6c50-416f-88dc-3ef246a4eb7b', 'volume_size': 1} Jul 10 00:45:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:29 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:45:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Flow 'volume_create_manager' (4556322a-f7a6-4239-88ae-a8f80260726d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f12e5e-c723-486c-8417-6a09e7245d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f12e5e-c723-486c-8417-6a09e7245d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-373178260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ccd625-d009-4682-9a9c-4de2e1d328e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826b2f7bb8364557a7dbe10d3f74162e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:29Z,use_quota=True,user_id='b39fae2a385141d8b07402cb66529ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f03d8b7-f83e-4266-8eef-5fd219fb1bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f03d8b7-f83e-4266-8eef-5fd219fb1bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53de11f2-df55-4f4b-886b-531d023b569d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53de11f2-df55-4f4b-886b-531d023b569d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88ccd625-d009-4682-9a9c-4de2e1d328e4', 'volume_name': 'volume-88ccd625-d009-4682-9a9c-4de2e1d328e4', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9ccfdc-736e-4299-a508-962468628e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9ccfdc-736e-4299-a508-962468628e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35876060-a6f0-4518-8765-4ff19aef595e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:29 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Volume 88ccd625-d009-4682-9a9c-4de2e1d328e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88ccd625-d009-4682-9a9c-4de2e1d328e4', 'volume_size': 1} Jul 10 00:45:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:29 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:45:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Flow 'volume_create_manager' (35eb91ee-2a5f-43a1-9611-d4cc481159f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:29 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddded812-05cf-4178-b3b9-faf8bcd017e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7 1073741824" returned: 0 in 1.244s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddded812-05cf-4178-b3b9-faf8bcd017e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2138239513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034d6e0b-8ac2-4668-8320-ce2c9f561b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826b2f7bb8364557a7dbe10d3f74162e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:30Z,use_quota=True,user_id='b39fae2a385141d8b07402cb66529ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1ada8a-82b2-4bef-ad66-ef30eb103cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1ada8a-82b2-4bef-ad66-ef30eb103cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1785dff8-70e0-4767-aea9-8bbc735e485d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1785dff8-70e0-4767-aea9-8bbc735e485d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '034d6e0b-8ac2-4668-8320-ce2c9f561b08', 'volume_name': 'volume-034d6e0b-8ac2-4668-8320-ce2c9f561b08', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f0b7cd-40e5-4029-9d97-8a0473add6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f0b7cd-40e5-4029-9d97-8a0473add6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cee71ab-e935-4d81-b631-2320af616273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:29 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Volume 034d6e0b-8ac2-4668-8320-ce2c9f561b08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-034d6e0b-8ac2-4668-8320-ce2c9f561b08', 'volume_size': 1} Jul 10 00:45:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:29 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7 Jul 10 00:45:29 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Flow 'volume_create_manager' (3438f8a3-11a4-4f64-8480-206a6261fe0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a28677-b8f1-4a0c-b2d7-ef1aa2548349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a28677-b8f1-4a0c-b2d7-ef1aa2548349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1528738600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826b2f7bb8364557a7dbe10d3f74162e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:30Z,use_quota=True,user_id='b39fae2a385141d8b07402cb66529ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9efe685-ce5a-4a85-bf58-493077136300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9efe685-ce5a-4a85-bf58-493077136300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f8c248-eb02-49b6-9fa8-e15e6fb5328d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f8c248-eb02-49b6-9fa8-e15e6fb5328d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8', 'volume_name': 'volume-2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deade882-d055-48cb-a3d1-b284a7875d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deade882-d055-48cb-a3d1-b284a7875d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d6a4334-0c86-4e59-a0c9-f7772ead1ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:30 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Volume 2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8', 'volume_size': 1} Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:30 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7" returned: 0 in 0.879s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] <== create_volume: return (2235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.238s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.983s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-715056039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d667c1e-f3b5-42d7-8529-5c9936a82a7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826b2f7bb8364557a7dbe10d3f74162e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:28Z,use_quota=True,user_id='b39fae2a385141d8b07402cb66529ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Creating volume 5d667c1e-f3b5-42d7-8529-5c9936a82a7d {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:45:30 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d667c1e-f3b5-42d7-8529-5c9936a82a7d 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48105eee-3f6b-4a9d-b30e-6a001382953b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc7007d7-754e-43c0-83be-6553da2822a7', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:30 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d667c1e-f3b5-42d7-8529-5c9936a82a7d 1073741824 Jul 10 00:45:30 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03581755-fbd4-4805-acab-00de0ee20741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:30 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Volume volume-bc7007d7-754e-43c0-83be-6553da2822a7 (bc7007d7-754e-43c0-83be-6553da2822a7): created successfully Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03581755-fbd4-4805-acab-00de0ee20741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Flow 'volume_create_manager' (58c2786f-bc01-4585-bb26-8b3a79c97ba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:30 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-ca3d29d4-b9bf-48a5-ae0c-000909eb60fd tempest-CreateVolumesFromSnapshotTest-1043600788 None] Created volume successfully. Jul 10 00:45:31 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:45:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Flow 'volume_create_manager' (681ad3d8-dc42-497b-a301-c9584f26e743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8bf06bc-2c30-466d-b617-6ad921ec1ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8bf06bc-2c30-466d-b617-6ad921ec1ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=237b6929-eea5-40d9-9a91-05000c9e4c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ff2d2424e941b892685fddf9f8824f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:31Z,use_quota=True,user_id='5be7a7dfb371445c820a30ba1857a365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c43992c-8c30-4e38-a146-50595018d2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c43992c-8c30-4e38-a146-50595018d2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cbb94c2-e16c-4789-bff8-3c2506fd7f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:31 devstack cinder-volume[88119]: DEBUG cinder.image.glance [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Creating Keystone auth plugin from conf {{(pid=88119) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 00:45:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6f70afe9-f19f-4376-9cf8-1fe56ed30f52 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:45:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cbb94c2-e16c-4789-bff8-3c2506fd7f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '237b6929-eea5-40d9-9a91-05000c9e4c19', 'volume_name': 'volume-237b6929-eea5-40d9-9a91-05000c9e4c19', 'volume_size': 1, 'image_id': 'c4f09059-7ec4-4d64-8c32-1e95aab47e87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4f09059-7ec4-4d64-8c32-1e95aab47e87', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '774d5eef3cb7a3e51e34f715b4280b9c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38ff2d2424e941b892685fddf9f8824f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '03530079966186ac7df1caad8df68cd60aa9aac73beb2aa8baaf7ef0a2e2233b33b6927a0cb7baa5daf912e11845df3b3811c3f3634bb09e8a963c60b875ccdb', 'id': 'c4f09059-7ec4-4d64-8c32-1e95aab47e87', 'created_at': datetime.datetime(2026, 7, 9, 22, 45, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 45, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4f09059-7ec4-4d64-8c32-1e95aab47e87/file', 'properties': {}}, 'image_service': }' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1efa4668-9e07-41b5-8252-14c5347f21fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:31 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:45:31 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1efa4668-9e07-41b5-8252-14c5347f21fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7eb0cc4-cff6-44c5-8838-8f540a69af71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:31 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Volume 237b6929-eea5-40d9-9a91-05000c9e4c19: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-237b6929-eea5-40d9-9a91-05000c9e4c19', 'volume_size': 1, 'image_id': 'c4f09059-7ec4-4d64-8c32-1e95aab47e87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4f09059-7ec4-4d64-8c32-1e95aab47e87', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '774d5eef3cb7a3e51e34f715b4280b9c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38ff2d2424e941b892685fddf9f8824f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '03530079966186ac7df1caad8df68cd60aa9aac73beb2aa8baaf7ef0a2e2233b33b6927a0cb7baa5daf912e11845df3b3811c3f3634bb09e8a963c60b875ccdb', 'id': 'c4f09059-7ec4-4d64-8c32-1e95aab47e87', 'created_at': datetime.datetime(2026, 7, 9, 22, 45, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 45, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4f09059-7ec4-4d64-8c32-1e95aab47e87/file', 'properties': {}}, 'image_service': } Jul 10 00:45:31 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Trying to clone 237b6929-eea5-40d9-9a91-05000c9e4c19 from image c4f09059-7ec4-4d64-8c32-1e95aab47e87 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c4f09059-7ec4-4d64-8c32-1e95aab47e87', 'metadata': {}}]). {{(pid=88119) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 00:45:31 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d667c1e-f3b5-42d7-8529-5c9936a82a7d 1073741824" returned: 0 in 1.109s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d667c1e-f3b5-42d7-8529-5c9936a82a7d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:31 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d667c1e-f3b5-42d7-8529-5c9936a82a7d Jul 10 00:45:31 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:31 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c4f09059-7ec4-4d64-8c32-1e95aab47e87_m_ovaf87devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 00:45:31 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Image download 0.00 MB at 0.00 MB/s Jul 10 00:45:31 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d884aee5-347c-437e-b1b0-8234cb976a6c]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f09059-7ec4-4d64-8c32-1e95aab47e87_m_ovaf87devstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:32 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f09059-7ec4-4d64-8c32-1e95aab47e87_m_ovaf87devstack@QuobyteHD Jul 10 00:45:32 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Flow 'volume_create_manager' (82305f77-73d6-4ead-8adc-c040cdde0afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbf887a-db4c-487b-baab-f09880784e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbf887a-db4c-487b-baab-f09880784e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35aea2b9-72d6-438b-a569-c6de4d829321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef234d3f4b8d445db70f7e43ad8bb75c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:32Z,use_quota=True,user_id='460b458345404841a53788396766abd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65e340da-0634-4d15-925c-a8b2e76da71a),volume_type_id=65e340da-0634-4d15-925c-a8b2e76da71a)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668ad563-326e-4c0f-926b-bcc907190982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668ad563-326e-4c0f-926b-bcc907190982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09f3be3-c8d9-4a8f-aee9-f0c54f495162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.image.glance [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Creating Keystone auth plugin from conf {{(pid=88119) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 00:45:32 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.774s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 29 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:45:32 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d667c1e-f3b5-42d7-8529-5c9936a82a7d" returned: 0 in 0.801s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.846s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-445631689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16110339-6c50-416f-88dc-3ef246a4eb7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826b2f7bb8364557a7dbe10d3f74162e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:28Z,use_quota=True,user_id='b39fae2a385141d8b07402cb66529ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Creating volume 16110339-6c50-416f-88dc-3ef246a4eb7b {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:45:32 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-16110339-6c50-416f-88dc-3ef246a4eb7b 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08775e70-918e-4586-ab4d-da74a366ca2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d667c1e-f3b5-42d7-8529-5c9936a82a7d', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:32 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-16110339-6c50-416f-88dc-3ef246a4eb7b 1073741824 Jul 10 00:45:32 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9140c3c-21c7-46f6-90a8-b03b1d38f805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:32 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Volume volume-5d667c1e-f3b5-42d7-8529-5c9936a82a7d (5d667c1e-f3b5-42d7-8529-5c9936a82a7d): created successfully Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9140c3c-21c7-46f6-90a8-b03b1d38f805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Flow 'volume_create_manager' (0d09db02-2760-4c22-8bde-056f3492b553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:32 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-f665e9b9-a883-4e31-981b-00c88bb29912 tempest-CreateVolumesFromImageTest-1349383049 None] Created volume successfully. Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09f3be3-c8d9-4a8f-aee9-f0c54f495162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '35aea2b9-72d6-438b-a569-c6de4d829321', 'volume_name': 'volume-35aea2b9-72d6-438b-a569-c6de4d829321', 'volume_size': 1, 'image_id': '1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd007b3cdf1d1ce6f5aae78f1599d585d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ef234d3f4b8d445db70f7e43ad8bb75c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e2b9e4fd9eba8dea2c2076b8de775b8405d1148e1ffae82bf93c202af97fe355467feaca80c53290695aca4e36945111ee1bbf05cd072c47d5ee25afeb47f5d1', 'id': '1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e', 'created_at': datetime.datetime(2026, 7, 9, 22, 45, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 45, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05b6658-9ea5-430b-833b-fd80b47e1f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05b6658-9ea5-430b-833b-fd80b47e1f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3033acd6-2b6a-4648-a3bf-67a03b442e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:32 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Volume 35aea2b9-72d6-438b-a569-c6de4d829321: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-35aea2b9-72d6-438b-a569-c6de4d829321', 'volume_size': 1, 'image_id': '1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd007b3cdf1d1ce6f5aae78f1599d585d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ef234d3f4b8d445db70f7e43ad8bb75c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e2b9e4fd9eba8dea2c2076b8de775b8405d1148e1ffae82bf93c202af97fe355467feaca80c53290695aca4e36945111ee1bbf05cd072c47d5ee25afeb47f5d1', 'id': '1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e', 'created_at': datetime.datetime(2026, 7, 9, 22, 45, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 45, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Trying to clone 35aea2b9-72d6-438b-a569-c6de4d829321 from image 1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e at location (None, [{'url': 'file:///opt/stack/data/glance/images/1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e', 'metadata': {}}]). {{(pid=88119) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 00:45:32 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f09059-7ec4-4d64-8c32-1e95aab47e87_m_ovaf87devstack@QuobyteHD" returned: 0 in 0.920s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f09059-7ec4-4d64-8c32-1e95aab47e87_m_ovaf87devstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e__i71hvlkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 00:45:32 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Image download 0.00 MB at 0.00 MB/s Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f5dd34-2801-482b-821f-03150936cce3]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e__i71hvlkdevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:32 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f09059-7ec4-4d64-8c32-1e95aab47e87_m_ovaf87devstack@QuobyteHD Jul 10 00:45:32 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:32 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e__i71hvlkdevstack@QuobyteHD Jul 10 00:45:32 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:33 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-16110339-6c50-416f-88dc-3ef246a4eb7b 1073741824" returned: 0 in 0.919s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-16110339-6c50-416f-88dc-3ef246a4eb7b {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:33 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f09059-7ec4-4d64-8c32-1e95aab47e87_m_ovaf87devstack@QuobyteHD" returned: 1 in 0.774s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f09059-7ec4-4d64-8c32-1e95aab47e87_m_ovaf87devstack@QuobyteHD' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:45:33 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Temporary image c4f09059-7ec4-4d64-8c32-1e95aab47e87 is fetched for user 5be7a7dfb371445c820a30ba1857a365. {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 00:45:33 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-16110339-6c50-416f-88dc-3ef246a4eb7b Jul 10 00:45:33 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:33 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3ad31d-1042-4f8d-a752-a791bb23eb2d]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f09059-7ec4-4d64-8c32-1e95aab47e87_m_ovaf87devstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:33 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e__i71hvlkdevstack@QuobyteHD" returned: 0 in 0.802s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e__i71hvlkdevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:33 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f09059-7ec4-4d64-8c32-1e95aab47e87_m_ovaf87devstack@QuobyteHD Jul 10 00:45:33 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:33 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e__i71hvlkdevstack@QuobyteHD Jul 10 00:45:33 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:34 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-16110339-6c50-416f-88dc-3ef246a4eb7b" returned: 0 in 0.677s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:45:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.012s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-373178260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ccd625-d009-4682-9a9c-4de2e1d328e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826b2f7bb8364557a7dbe10d3f74162e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:29Z,use_quota=True,user_id='b39fae2a385141d8b07402cb66529ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:45:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Creating volume 88ccd625-d009-4682-9a9c-4de2e1d328e4 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:45:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:45:34 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:45:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-88ccd625-d009-4682-9a9c-4de2e1d328e4 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (920a0894-f608-4183-abc9-467098526a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16110339-6c50-416f-88dc-3ef246a4eb7b', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:34 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-88ccd625-d009-4682-9a9c-4de2e1d328e4 1073741824 Jul 10 00:45:34 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d668f98-9be6-4380-8f98-13b2abb25374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:34 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Volume volume-16110339-6c50-416f-88dc-3ef246a4eb7b (16110339-6c50-416f-88dc-3ef246a4eb7b): created successfully Jul 10 00:45:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d668f98-9be6-4380-8f98-13b2abb25374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:34 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Flow 'volume_create_manager' (3ceb37dd-c2af-41ac-bb5e-d2ca8fb3f066) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:34 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-762a3d75-5eff-49ad-9e6a-d4b403cc35fe tempest-CreateVolumesFromImageTest-1349383049 None] Created volume successfully. Jul 10 00:45:34 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f09059-7ec4-4d64-8c32-1e95aab47e87_m_ovaf87devstack@QuobyteHD" returned: 0 in 0.774s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f09059-7ec4-4d64-8c32-1e95aab47e87_m_ovaf87devstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:34 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e__i71hvlkdevstack@QuobyteHD" returned: 1 in 0.768s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e__i71hvlkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:45:34 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Temporary image 1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e is fetched for user 460b458345404841a53788396766abd2. {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 00:45:34 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8458c9d7-2618-4dc0-801c-15a39ce2ceab]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e__i71hvlkdevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:34 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f09059-7ec4-4d64-8c32-1e95aab47e87_m_ovaf87devstack@QuobyteHD Jul 10 00:45:34 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:34 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e__i71hvlkdevstack@QuobyteHD Jul 10 00:45:34 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:35 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-88ccd625-d009-4682-9a9c-4de2e1d328e4 1073741824" returned: 0 in 0.864s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-88ccd625-d009-4682-9a9c-4de2e1d328e4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:35 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-88ccd625-d009-4682-9a9c-4de2e1d328e4 Jul 10 00:45:35 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:35 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f09059-7ec4-4d64-8c32-1e95aab47e87_m_ovaf87devstack@QuobyteHD" returned: 1 in 0.762s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f09059-7ec4-4d64-8c32-1e95aab47e87_m_ovaf87devstack@QuobyteHD' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:45:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:35 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e__i71hvlkdevstack@QuobyteHD" returned: 0 in 0.769s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e__i71hvlkdevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:35 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e__i71hvlkdevstack@QuobyteHD Jul 10 00:45:35 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:35 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-88ccd625-d009-4682-9a9c-4de2e1d328e4" returned: 0 in 0.653s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:45:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.119s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2138239513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034d6e0b-8ac2-4668-8320-ce2c9f561b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826b2f7bb8364557a7dbe10d3f74162e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:30Z,use_quota=True,user_id='b39fae2a385141d8b07402cb66529ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:45:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Creating volume 034d6e0b-8ac2-4668-8320-ce2c9f561b08 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:45:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:45:35 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:45:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-034d6e0b-8ac2-4668-8320-ce2c9f561b08 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:35 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-034d6e0b-8ac2-4668-8320-ce2c9f561b08 1073741824 Jul 10 00:45:35 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35876060-a6f0-4518-8765-4ff19aef595e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88ccd625-d009-4682-9a9c-4de2e1d328e4', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5751b1de-1da7-46ad-ac81-ac748fde6fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:35 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Volume volume-88ccd625-d009-4682-9a9c-4de2e1d328e4 (88ccd625-d009-4682-9a9c-4de2e1d328e4): created successfully Jul 10 00:45:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5751b1de-1da7-46ad-ac81-ac748fde6fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Flow 'volume_create_manager' (4556322a-f7a6-4239-88ae-a8f80260726d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:35 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-1d95d8a2-d74a-4ff6-98d8-13468c17f455 tempest-CreateVolumesFromImageTest-1349383049 None] Created volume successfully. Jul 10 00:45:36 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e__i71hvlkdevstack@QuobyteHD" returned: 1 in 0.724s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e__i71hvlkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:45:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:36 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-034d6e0b-8ac2-4668-8320-ce2c9f561b08 1073741824" returned: 0 in 0.789s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-034d6e0b-8ac2-4668-8320-ce2c9f561b08 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:36 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-034d6e0b-8ac2-4668-8320-ce2c9f561b08 Jul 10 00:45:36 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:37 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-034d6e0b-8ac2-4668-8320-ce2c9f561b08" returned: 0 in 0.610s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:45:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.026s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1528738600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826b2f7bb8364557a7dbe10d3f74162e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:30Z,use_quota=True,user_id='b39fae2a385141d8b07402cb66529ab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:45:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Creating volume 2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:45:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:45:37 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:45:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cee71ab-e935-4d81-b631-2320af616273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-034d6e0b-8ac2-4668-8320-ce2c9f561b08', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:37 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8 1073741824 Jul 10 00:45:37 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c92833-54b8-42de-abe5-003fbd45c8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:37 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Volume volume-034d6e0b-8ac2-4668-8320-ce2c9f561b08 (034d6e0b-8ac2-4668-8320-ce2c9f561b08): created successfully Jul 10 00:45:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c92833-54b8-42de-abe5-003fbd45c8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Flow 'volume_create_manager' (35eb91ee-2a5f-43a1-9611-d4cc481159f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:37 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-8d3872c9-76d3-435b-877c-deb3ed1b1d60 tempest-CreateVolumesFromImageTest-1349383049 None] Created volume successfully. Jul 10 00:45:38 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8 1073741824" returned: 0 in 0.781s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:38 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8 Jul 10 00:45:38 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:38 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8" returned: 0 in 0.625s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:38 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:45:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6f70afe9-f19f-4376-9cf8-1fe56ed30f52 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.230s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d6a4334-0c86-4e59-a0c9-f7772ead1ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8e9f22-a7c2-435f-925d-3c019e172ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:38 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-6f70afe9-f19f-4376-9cf8-1fe56ed30f52 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Creating offline snapshot 00d670ac-d63f-480b-8654-3872bcef3af9 of volume bc7007d7-754e-43c0-83be-6553da2822a7 {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:45:38 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Volume volume-2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8 (2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8): created successfully Jul 10 00:45:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8e9f22-a7c2-435f-925d-3c019e172ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Flow 'volume_create_manager' (3438f8a3-11a4-4f64-8480-206a6261fe0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:38 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[025d9d20-521d-4b6a-b77c-36ed08a99e7f]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6f70afe9-f19f-4376-9cf8-1fe56ed30f52 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:38 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-e6141111-3fee-451a-8556-14dcff2ad140 tempest-CreateVolumesFromImageTest-1349383049 None] Created volume successfully. Jul 10 00:45:38 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7 Jul 10 00:45:38 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:39 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-6860a6e2-da3f-415b-855a-69a851713003 tempest-CreateVolumesFromImageTest-1349383049 None] Acquiring lock "cinder-2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:39 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-6860a6e2-da3f-415b-855a-69a851713003 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "cinder-2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:39 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-6860a6e2-da3f-415b-855a-69a851713003 tempest-CreateVolumesFromImageTest-1349383049 None] Acquiring lock "cinder-quobyte-2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:39 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-6860a6e2-da3f-415b-855a-69a851713003 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "cinder-quobyte-2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8" acquired by "delete_volume" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:39 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[a090e91f-363d-411b-a321-ae269a73ad44]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6860a6e2-da3f-415b-855a-69a851713003 tempest-CreateVolumesFromImageTest-1349383049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:39 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8 Jul 10 00:45:39 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:39 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6f70afe9-f19f-4376-9cf8-1fe56ed30f52 tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7" returned: 0 in 0.752s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6f70afe9-f19f-4376-9cf8-1fe56ed30f52 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7.00d670ac-d63f-480b-8654-3872bcef3af9 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:39 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7.00d670ac-d63f-480b-8654-3872bcef3af9 1G Jul 10 00:45:39 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:39 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6860a6e2-da3f-415b-855a-69a851713003 tempest-CreateVolumesFromImageTest-1349383049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8" returned: 0 in 0.781s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6860a6e2-da3f-415b-855a-69a851713003 tempest-CreateVolumesFromImageTest-1349383049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:39 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8 Jul 10 00:45:39 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:40 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6f70afe9-f19f-4376-9cf8-1fe56ed30f52 tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7.00d670ac-d63f-480b-8654-3872bcef3af9 1G" returned: 0 in 0.772s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6f70afe9-f19f-4376-9cf8-1fe56ed30f52 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc7007d7-754e-43c0-83be-6553da2822a7 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7.00d670ac-d63f-480b-8654-3872bcef3af9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:40 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc7007d7-754e-43c0-83be-6553da2822a7 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7.00d670ac-d63f-480b-8654-3872bcef3af9 Jul 10 00:45:40 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:40 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6860a6e2-da3f-415b-855a-69a851713003 tempest-CreateVolumesFromImageTest-1349383049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8" returned: 0 in 0.658s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:40 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-6860a6e2-da3f-415b-855a-69a851713003 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "cinder-quobyte-2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8" released by "delete_volume" :: held 1.498s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:40 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-6860a6e2-da3f-415b-855a-69a851713003 tempest-CreateVolumesFromImageTest-1349383049 None] Created reservations ['fc4cd753-fb41-416f-ac02-90c91f96ccb7', '269529db-1215-4f8b-a651-ec5f3fb84264', 'dc4d8823-c87b-4123-a5d1-d591ff020d0d', '9920e67a-6012-4a73-a93c-ae4d5c264640'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:45:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6860a6e2-da3f-415b-855a-69a851713003 tempest-CreateVolumesFromImageTest-1349383049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6860a6e2-da3f-415b-855a-69a851713003 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-6860a6e2-da3f-415b-855a-69a851713003 tempest-CreateVolumesFromImageTest-1349383049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-6860a6e2-da3f-415b-855a-69a851713003 tempest-CreateVolumesFromImageTest-1349383049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6860a6e2-da3f-415b-855a-69a851713003 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6860a6e2-da3f-415b-855a-69a851713003 tempest-CreateVolumesFromImageTest-1349383049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:40 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:45:40 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:41 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6f70afe9-f19f-4376-9cf8-1fe56ed30f52 tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc7007d7-754e-43c0-83be-6553da2822a7 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7.00d670ac-d63f-480b-8654-3872bcef3af9" returned: 0 in 0.728s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:41 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-6f70afe9-f19f-4376-9cf8-1fe56ed30f52 tempest-CreateVolumesFromSnapshotTest-1043600788 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7.00d670ac-d63f-480b-8654-3872bcef3af9 is being set with open permissions: ugo+rw Jul 10 00:45:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6f70afe9-f19f-4376-9cf8-1fe56ed30f52 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7.00d670ac-d63f-480b-8654-3872bcef3af9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:41 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7.00d670ac-d63f-480b-8654-3872bcef3af9 Jul 10 00:45:41 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:41 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-313a6d4c-78d5-4db2-b526-030450a7b116 tempest-CreateVolumesFromImageTest-1349383049 None] Acquiring lock "cinder-034d6e0b-8ac2-4668-8320-ce2c9f561b08-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:41 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-313a6d4c-78d5-4db2-b526-030450a7b116 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "cinder-034d6e0b-8ac2-4668-8320-ce2c9f561b08-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:41 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-313a6d4c-78d5-4db2-b526-030450a7b116 tempest-CreateVolumesFromImageTest-1349383049 None] Acquiring lock "cinder-quobyte-034d6e0b-8ac2-4668-8320-ce2c9f561b08" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:41 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-313a6d4c-78d5-4db2-b526-030450a7b116 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "cinder-quobyte-034d6e0b-8ac2-4668-8320-ce2c9f561b08" acquired by "delete_volume" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:41 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b990751a-a1ca-4f4d-a274-7e98095cf314]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-313a6d4c-78d5-4db2-b526-030450a7b116 tempest-CreateVolumesFromImageTest-1349383049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-034d6e0b-8ac2-4668-8320-ce2c9f561b08 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:41 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6860a6e2-da3f-415b-855a-69a851713003 tempest-CreateVolumesFromImageTest-1349383049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.715s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:41 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-6860a6e2-da3f-415b-855a-69a851713003 tempest-CreateVolumesFromImageTest-1349383049 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:45:41 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-6860a6e2-da3f-415b-855a-69a851713003 tempest-CreateVolumesFromImageTest-1349383049 None] Deleted volume successfully. Jul 10 00:45:41 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-6860a6e2-da3f-415b-855a-69a851713003 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "cinder-2679cd8c-8ea4-49cb-8fdf-a6e497a2cca8-delete_volume" released by "delete_volume" :: held 2.459s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:41 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-034d6e0b-8ac2-4668-8320-ce2c9f561b08 Jul 10 00:45:41 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:41 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6f70afe9-f19f-4376-9cf8-1fe56ed30f52 tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7.00d670ac-d63f-480b-8654-3872bcef3af9" returned: 0 in 0.708s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6f70afe9-f19f-4376-9cf8-1fe56ed30f52 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:41 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7.info Jul 10 00:45:41 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:42 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-313a6d4c-78d5-4db2-b526-030450a7b116 tempest-CreateVolumesFromImageTest-1349383049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-034d6e0b-8ac2-4668-8320-ce2c9f561b08" returned: 0 in 0.808s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-313a6d4c-78d5-4db2-b526-030450a7b116 tempest-CreateVolumesFromImageTest-1349383049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-034d6e0b-8ac2-4668-8320-ce2c9f561b08 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:42 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-034d6e0b-8ac2-4668-8320-ce2c9f561b08 Jul 10 00:45:42 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:42 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6f70afe9-f19f-4376-9cf8-1fe56ed30f52 tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7.info" returned: 0 in 0.680s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:42 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-6f70afe9-f19f-4376-9cf8-1fe56ed30f52 tempest-CreateVolumesFromSnapshotTest-1043600788 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7.info is being set with open permissions: ugo+rw Jul 10 00:45:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6f70afe9-f19f-4376-9cf8-1fe56ed30f52 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:42 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7.info Jul 10 00:45:42 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:42 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-313a6d4c-78d5-4db2-b526-030450a7b116 tempest-CreateVolumesFromImageTest-1349383049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-034d6e0b-8ac2-4668-8320-ce2c9f561b08" returned: 0 in 0.653s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:42 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-313a6d4c-78d5-4db2-b526-030450a7b116 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "cinder-quobyte-034d6e0b-8ac2-4668-8320-ce2c9f561b08" released by "delete_volume" :: held 1.514s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:42 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-313a6d4c-78d5-4db2-b526-030450a7b116 tempest-CreateVolumesFromImageTest-1349383049 None] Created reservations ['39e94788-50c7-4afe-bace-2f4564120b3a', 'a16114e6-c89c-44cd-8431-54bd3741baa6', '45717031-32f5-4055-be70-2420bae4d3ae', '96521ba3-afce-4830-b22f-c8c739e07e31'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:45:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-313a6d4c-78d5-4db2-b526-030450a7b116 tempest-CreateVolumesFromImageTest-1349383049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-313a6d4c-78d5-4db2-b526-030450a7b116 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:42 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-313a6d4c-78d5-4db2-b526-030450a7b116 tempest-CreateVolumesFromImageTest-1349383049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:42 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-313a6d4c-78d5-4db2-b526-030450a7b116 tempest-CreateVolumesFromImageTest-1349383049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-313a6d4c-78d5-4db2-b526-030450a7b116 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-313a6d4c-78d5-4db2-b526-030450a7b116 tempest-CreateVolumesFromImageTest-1349383049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:42 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:45:42 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:43 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6f70afe9-f19f-4376-9cf8-1fe56ed30f52 tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7.info" returned: 0 in 0.686s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6f70afe9-f19f-4376-9cf8-1fe56ed30f52 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.441s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.967s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=237b6929-eea5-40d9-9a91-05000c9e4c19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ff2d2424e941b892685fddf9f8824f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:31Z,use_quota=True,user_id='5be7a7dfb371445c820a30ba1857a365',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:45:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Creating volume 237b6929-eea5-40d9-9a91-05000c9e4c19 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:45:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:45:43 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:45:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:43 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19 1073741824 Jul 10 00:45:43 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:43 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-6f70afe9-f19f-4376-9cf8-1fe56ed30f52 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Create snapshot completed successfully Jul 10 00:45:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-92aa1397-c69c-433b-8a36-95176e609ecd tempest-CreateVolumesFromImageTest-1349383049 None] Acquiring lock "cinder-88ccd625-d009-4682-9a9c-4de2e1d328e4-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-92aa1397-c69c-433b-8a36-95176e609ecd tempest-CreateVolumesFromImageTest-1349383049 None] Lock "cinder-88ccd625-d009-4682-9a9c-4de2e1d328e4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-92aa1397-c69c-433b-8a36-95176e609ecd tempest-CreateVolumesFromImageTest-1349383049 None] Acquiring lock "cinder-quobyte-88ccd625-d009-4682-9a9c-4de2e1d328e4" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-92aa1397-c69c-433b-8a36-95176e609ecd tempest-CreateVolumesFromImageTest-1349383049 None] Lock "cinder-quobyte-88ccd625-d009-4682-9a9c-4de2e1d328e4" acquired by "delete_volume" :: waited 0.021s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:43 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[77680f8f-94be-4319-b3fe-feeb38e46da4]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92aa1397-c69c-433b-8a36-95176e609ecd tempest-CreateVolumesFromImageTest-1349383049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-88ccd625-d009-4682-9a9c-4de2e1d328e4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:43 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-313a6d4c-78d5-4db2-b526-030450a7b116 tempest-CreateVolumesFromImageTest-1349383049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.695s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:43 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-313a6d4c-78d5-4db2-b526-030450a7b116 tempest-CreateVolumesFromImageTest-1349383049 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:45:43 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-313a6d4c-78d5-4db2-b526-030450a7b116 tempest-CreateVolumesFromImageTest-1349383049 None] Deleted volume successfully. Jul 10 00:45:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-313a6d4c-78d5-4db2-b526-030450a7b116 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "cinder-034d6e0b-8ac2-4668-8320-ce2c9f561b08-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:43 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-88ccd625-d009-4682-9a9c-4de2e1d328e4 Jul 10 00:45:43 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:44 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19 1073741824" returned: 0 in 0.888s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:44 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19 Jul 10 00:45:44 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:44 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92aa1397-c69c-433b-8a36-95176e609ecd tempest-CreateVolumesFromImageTest-1349383049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-88ccd625-d009-4682-9a9c-4de2e1d328e4" returned: 0 in 0.880s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92aa1397-c69c-433b-8a36-95176e609ecd tempest-CreateVolumesFromImageTest-1349383049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-88ccd625-d009-4682-9a9c-4de2e1d328e4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:45:44 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-88ccd625-d009-4682-9a9c-4de2e1d328e4 Jul 10 00:45:44 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Flow 'volume_create_manager' (b2c94554-b328-4372-8b11-b216a57bfd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c84e65-71a3-4669-855c-45c325fbd331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c84e65-71a3-4669-855c-45c325fbd331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-506602112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1156cef-c5e5-45bf-852a-fb093cabde07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443d3952114443f48efce025f4426fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:44Z,use_quota=True,user_id='80259720603b4b9db2bf0274551f0482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0115fce3-2292-49e5-9b3d-7c544b9db9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0115fce3-2292-49e5-9b3d-7c544b9db9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e088b5-779f-4e42-8941-edf9eec0c6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e088b5-779f-4e42-8941-edf9eec0c6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1156cef-c5e5-45bf-852a-fb093cabde07', 'volume_name': 'volume-a1156cef-c5e5-45bf-852a-fb093cabde07', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d59919b-008f-41e3-805a-59fc2c1f4a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d59919b-008f-41e3-805a-59fc2c1f4a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6efd8771-86a5-4b42-bc34-86cd01f1adf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:44 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Volume a1156cef-c5e5-45bf-852a-fb093cabde07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1156cef-c5e5-45bf-852a-fb093cabde07', 'volume_size': 1} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:44 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19" returned: 0 in 0.707s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.800s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35aea2b9-72d6-438b-a569-c6de4d829321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef234d3f4b8d445db70f7e43ad8bb75c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:32Z,use_quota=True,user_id='460b458345404841a53788396766abd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65e340da-0634-4d15-925c-a8b2e76da71a),volume_type_id=65e340da-0634-4d15-925c-a8b2e76da71a)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Creating volume 35aea2b9-72d6-438b-a569-c6de4d829321 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:45:44 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:44 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321 1073741824 Jul 10 00:45:44 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Attempting download of c4f09059-7ec4-4d64-8c32-1e95aab47e87 ((None, [{'url': 'file:///opt/stack/data/glance/images/c4f09059-7ec4-4d64-8c32-1e95aab47e87', 'metadata': {}}])) to volume 237b6929-eea5-40d9-9a91-05000c9e4c19. {{(pid=88119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Flow 'volume_create_manager' (05b9dc10-6a5e-499a-a1e6-824af742239f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a24e8c2b-0890-4cbf-b85f-3a0279e4b89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a24e8c2b-0890-4cbf-b85f-3a0279e4b89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1378083677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443d3952114443f48efce025f4426fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:45Z,use_quota=True,user_id='80259720603b4b9db2bf0274551f0482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0b74be-266c-4052-957f-ad566ab3b1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0b74be-266c-4052-957f-ad566ab3b1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b53aa43-997d-4d09-8d09-e7f64f159671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b53aa43-997d-4d09-8d09-e7f64f159671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc', 'volume_name': 'volume-6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1067cb12-dda6-4e0e-a342-0dbdb2954490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1067cb12-dda6-4e0e-a342-0dbdb2954490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24391a56-23b7-4c16-a2db-0f4ea35fd7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:45 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Volume 6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc', 'volume_size': 1} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c20748b-b769-41e0-905c-85aeb14fd80c]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4f09059-7ec4-4d64-8c32-1e95aab47e87_kh6t98gi {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:45 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4f09059-7ec4-4d64-8c32-1e95aab47e87_kh6t98gi Jul 10 00:45:45 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:45 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92aa1397-c69c-433b-8a36-95176e609ecd tempest-CreateVolumesFromImageTest-1349383049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-88ccd625-d009-4682-9a9c-4de2e1d328e4" returned: 0 in 0.909s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-92aa1397-c69c-433b-8a36-95176e609ecd tempest-CreateVolumesFromImageTest-1349383049 None] Lock "cinder-quobyte-88ccd625-d009-4682-9a9c-4de2e1d328e4" released by "delete_volume" :: held 1.840s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Flow 'volume_create_manager' (8767522e-c07b-4878-a25b-a8394be26124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (124cf529-50b3-46ec-860b-247de5d76744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (124cf529-50b3-46ec-860b-247de5d76744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-886398747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f36200c4-71c2-4344-8c79-3d6ee46bfca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443d3952114443f48efce025f4426fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:45Z,use_quota=True,user_id='80259720603b4b9db2bf0274551f0482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b69938-352d-429a-a115-9aa682273cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b69938-352d-429a-a115-9aa682273cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6344d5ff-0a32-4036-a649-71f9da25307d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6344d5ff-0a32-4036-a649-71f9da25307d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f36200c4-71c2-4344-8c79-3d6ee46bfca3', 'volume_name': 'volume-f36200c4-71c2-4344-8c79-3d6ee46bfca3', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80366c32-e1e6-45ce-b94c-716702b86b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80366c32-e1e6-45ce-b94c-716702b86b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ee28be-f01a-428d-9da5-431662d7f6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:45 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Volume f36200c4-71c2-4344-8c79-3d6ee46bfca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f36200c4-71c2-4344-8c79-3d6ee46bfca3', 'volume_size': 1} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-92aa1397-c69c-433b-8a36-95176e609ecd tempest-CreateVolumesFromImageTest-1349383049 None] Created reservations ['832498ab-da06-4810-84a3-a688bc5602f4', 'd82ae4f8-d48a-4d2b-a728-77e741f91e5d', 'be7958b2-0970-46ef-af0f-604befd4bb87', 'b6883d88-50ef-4db5-bbc0-eb8eccff8077'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-92aa1397-c69c-433b-8a36-95176e609ecd tempest-CreateVolumesFromImageTest-1349383049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-92aa1397-c69c-433b-8a36-95176e609ecd tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-92aa1397-c69c-433b-8a36-95176e609ecd tempest-CreateVolumesFromImageTest-1349383049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-92aa1397-c69c-433b-8a36-95176e609ecd tempest-CreateVolumesFromImageTest-1349383049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-92aa1397-c69c-433b-8a36-95176e609ecd tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92aa1397-c69c-433b-8a36-95176e609ecd tempest-CreateVolumesFromImageTest-1349383049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:45 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:45:45 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-47aae464-7552-4bc7-8b9e-1e2667548cf8 tempest-CreateVolumesFromImageTest-1349383049 None] Acquiring lock "cinder-16110339-6c50-416f-88dc-3ef246a4eb7b-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-47aae464-7552-4bc7-8b9e-1e2667548cf8 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "cinder-16110339-6c50-416f-88dc-3ef246a4eb7b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Flow 'volume_create_manager' (76c2c9e6-be6a-4a74-a6ff-26c847c4a8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97d9a68-033e-40c1-9daf-aad4bb95ae10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97d9a68-033e-40c1-9daf-aad4bb95ae10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1162500746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1adfc0e5-7f71-4bc6-991e-351f67330dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443d3952114443f48efce025f4426fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:46Z,use_quota=True,user_id='80259720603b4b9db2bf0274551f0482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4350a1f-6b0e-47e5-aeef-dd4dbfc030a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4350a1f-6b0e-47e5-aeef-dd4dbfc030a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0569bcb1-9a29-4739-9789-aa0c44b4348f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0569bcb1-9a29-4739-9789-aa0c44b4348f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1adfc0e5-7f71-4bc6-991e-351f67330dff', 'volume_name': 'volume-1adfc0e5-7f71-4bc6-991e-351f67330dff', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:46 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afbca3b9-8a05-460c-970e-39b8a0d14699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afbca3b9-8a05-460c-970e-39b8a0d14699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a8fbb52-6492-41eb-b721-ed79435a9b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:46 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:46 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Volume 1adfc0e5-7f71-4bc6-991e-351f67330dff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1adfc0e5-7f71-4bc6-991e-351f67330dff', 'volume_size': 1} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321 1073741824" returned: 0 in 1.290s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c4f09059-7ec4-4d64-8c32-1e95aab47e87_kh6t98gi" returned: 0 in 1.036s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4f09059-7ec4-4d64-8c32-1e95aab47e87_kh6t98gi {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-47aae464-7552-4bc7-8b9e-1e2667548cf8 tempest-CreateVolumesFromImageTest-1349383049 None] Acquiring lock "cinder-quobyte-16110339-6c50-416f-88dc-3ef246a4eb7b" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-47aae464-7552-4bc7-8b9e-1e2667548cf8 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "cinder-quobyte-16110339-6c50-416f-88dc-3ef246a4eb7b" acquired by "delete_volume" :: waited 0.040s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a7a1fb-fb7f-4c11-b82e-4585741f0592]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-47aae464-7552-4bc7-8b9e-1e2667548cf8 tempest-CreateVolumesFromImageTest-1349383049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-16110339-6c50-416f-88dc-3ef246a4eb7b {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:46 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321 Jul 10 00:45:46 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:46 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4f09059-7ec4-4d64-8c32-1e95aab47e87_kh6t98gi Jul 10 00:45:46 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:46 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-16110339-6c50-416f-88dc-3ef246a4eb7b Jul 10 00:45:46 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Flow 'volume_create_manager' (baaeef05-0069-4734-9976-75740b183bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b165d4d2-7eea-4346-9e8a-b8ff93f3996f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:46 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b165d4d2-7eea-4346-9e8a-b8ff93f3996f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-94007449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba08769-5b34-48f5-9266-927f7fc01d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443d3952114443f48efce025f4426fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:47Z,use_quota=True,user_id='80259720603b4b9db2bf0274551f0482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaad7a1c-e3b9-43e6-b0cc-028e7d3ea2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaad7a1c-e3b9-43e6-b0cc-028e7d3ea2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9511f7fd-9fa3-43f2-9721-4904e14f288a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9511f7fd-9fa3-43f2-9721-4904e14f288a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ba08769-5b34-48f5-9266-927f7fc01d8f', 'volume_name': 'volume-6ba08769-5b34-48f5-9266-927f7fc01d8f', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f1ca46-44d8-4f3d-96b7-b122396ebfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f1ca46-44d8-4f3d-96b7-b122396ebfc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e8454c-3ee8-42ac-93c0-b24aa279c908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:46 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Volume 6ba08769-5b34-48f5-9266-927f7fc01d8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ba08769-5b34-48f5-9266-927f7fc01d8f', 'volume_size': 1} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-92aa1397-c69c-433b-8a36-95176e609ecd tempest-CreateVolumesFromImageTest-1349383049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.038s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-92aa1397-c69c-433b-8a36-95176e609ecd tempest-CreateVolumesFromImageTest-1349383049 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:45:46 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-92aa1397-c69c-433b-8a36-95176e609ecd tempest-CreateVolumesFromImageTest-1349383049 None] Deleted volume successfully. Jul 10 00:45:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-92aa1397-c69c-433b-8a36-95176e609ecd tempest-CreateVolumesFromImageTest-1349383049 None] Lock "cinder-88ccd625-d009-4682-9a9c-4de2e1d328e4-delete_volume" released by "delete_volume" :: held 3.288s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:47 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321" returned: 0 in 0.744s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] <== create_volume: return (2183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.186s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.402s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-506602112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1156cef-c5e5-45bf-852a-fb093cabde07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443d3952114443f48efce025f4426fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:44Z,use_quota=True,user_id='80259720603b4b9db2bf0274551f0482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Creating volume a1156cef-c5e5-45bf-852a-fb093cabde07 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:45:47 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a1156cef-c5e5-45bf-852a-fb093cabde07 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:47 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a1156cef-c5e5-45bf-852a-fb093cabde07 1073741824 Jul 10 00:45:47 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Attempting download of 1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e ((None, [{'url': 'file:///opt/stack/data/glance/images/1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e', 'metadata': {}}])) to volume 35aea2b9-72d6-438b-a569-c6de4d829321. {{(pid=88119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b5d337-69ec-4c7e-9f59-819311f00478]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e_7aksm6fx {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:47 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:47 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4f09059-7ec4-4d64-8c32-1e95aab47e87_kh6t98gi" returned: 1 in 1.020s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c4f09059-7ec4-4d64-8c32-1e95aab47e87_kh6t98gi' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-47aae464-7552-4bc7-8b9e-1e2667548cf8 tempest-CreateVolumesFromImageTest-1349383049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-16110339-6c50-416f-88dc-3ef246a4eb7b" returned: 0 in 0.909s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-47aae464-7552-4bc7-8b9e-1e2667548cf8 tempest-CreateVolumesFromImageTest-1349383049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-16110339-6c50-416f-88dc-3ef246a4eb7b {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[92380507-be7e-42d6-8b4d-db1ea65fd596]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f09059-7ec4-4d64-8c32-1e95aab47e87_m_ovaf87devstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:47 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-16110339-6c50-416f-88dc-3ef246a4eb7b Jul 10 00:45:47 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:47 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e_7aksm6fx Jul 10 00:45:47 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:47 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f09059-7ec4-4d64-8c32-1e95aab47e87_m_ovaf87devstack@QuobyteHD Jul 10 00:45:47 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:47 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-47aae464-7552-4bc7-8b9e-1e2667548cf8 tempest-CreateVolumesFromImageTest-1349383049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-16110339-6c50-416f-88dc-3ef246a4eb7b" returned: 0 in 0.732s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-47aae464-7552-4bc7-8b9e-1e2667548cf8 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "cinder-quobyte-16110339-6c50-416f-88dc-3ef246a4eb7b" released by "delete_volume" :: held 1.695s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:47 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a1156cef-c5e5-45bf-852a-fb093cabde07 1073741824" returned: 0 in 0.914s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:47 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e_7aksm6fx" returned: 0 in 0.839s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e_7aksm6fx {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a1156cef-c5e5-45bf-852a-fb093cabde07 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-47aae464-7552-4bc7-8b9e-1e2667548cf8 tempest-CreateVolumesFromImageTest-1349383049 None] Created reservations ['036c58d2-1137-4ba9-bdce-425e0f39de4b', '3f7abc56-a015-4460-94ff-91f381e3ac9b', '7e816557-6f3e-4eb8-a6fd-45324a1a6c76', '10cc0b1a-1f92-4afc-84f7-fbc8cc8d1aad'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:45:48 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f09059-7ec4-4d64-8c32-1e95aab47e87_m_ovaf87devstack@QuobyteHD" returned: 0 in 0.846s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f09059-7ec4-4d64-8c32-1e95aab47e87_m_ovaf87devstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:48 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a1156cef-c5e5-45bf-852a-fb093cabde07 Jul 10 00:45:48 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-47aae464-7552-4bc7-8b9e-1e2667548cf8 tempest-CreateVolumesFromImageTest-1349383049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-47aae464-7552-4bc7-8b9e-1e2667548cf8 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-47aae464-7552-4bc7-8b9e-1e2667548cf8 tempest-CreateVolumesFromImageTest-1349383049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-47aae464-7552-4bc7-8b9e-1e2667548cf8 tempest-CreateVolumesFromImageTest-1349383049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-47aae464-7552-4bc7-8b9e-1e2667548cf8 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-47aae464-7552-4bc7-8b9e-1e2667548cf8 tempest-CreateVolumesFromImageTest-1349383049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:48 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e_7aksm6fx Jul 10 00:45:48 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:48 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:45:48 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:48 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f09059-7ec4-4d64-8c32-1e95aab47e87_m_ovaf87devstack@QuobyteHD Jul 10 00:45:48 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:48 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a1156cef-c5e5-45bf-852a-fb093cabde07" returned: 0 in 0.790s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.696s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1378083677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443d3952114443f48efce025f4426fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:45Z,use_quota=True,user_id='80259720603b4b9db2bf0274551f0482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Creating volume 6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:45:48 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:48 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e_7aksm6fx" returned: 1 in 0.844s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e_7aksm6fx' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefbc163-e81e-4eda-8664-b71f19890967]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e__i71hvlkdevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:48 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc 1073741824 Jul 10 00:45:48 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:48 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-47aae464-7552-4bc7-8b9e-1e2667548cf8 tempest-CreateVolumesFromImageTest-1349383049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.729s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-47aae464-7552-4bc7-8b9e-1e2667548cf8 tempest-CreateVolumesFromImageTest-1349383049 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6efd8771-86a5-4b42-bc34-86cd01f1adf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1156cef-c5e5-45bf-852a-fb093cabde07', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de01711-2993-4cc6-90fb-a7e839ed0569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:48 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-47aae464-7552-4bc7-8b9e-1e2667548cf8 tempest-CreateVolumesFromImageTest-1349383049 None] Deleted volume successfully. Jul 10 00:45:48 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Volume volume-a1156cef-c5e5-45bf-852a-fb093cabde07 (a1156cef-c5e5-45bf-852a-fb093cabde07): created successfully Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de01711-2993-4cc6-90fb-a7e839ed0569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:48 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Flow 'volume_create_manager' (b2c94554-b328-4372-8b11-b216a57bfd93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f09059-7ec4-4d64-8c32-1e95aab47e87_m_ovaf87devstack@QuobyteHD" returned: 1 in 0.890s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c4f09059-7ec4-4d64-8c32-1e95aab47e87_m_ovaf87devstack@QuobyteHD' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] c4f09059-7ec4-4d64-8c32-1e95aab47e87 was raw, converting to raw {{(pid=88119) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c4f09059-7ec4-4d64-8c32-1e95aab47e87_m_ovaf87devstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:48 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-8c9a11b1-b007-41de-9dbb-1c2e05227669 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Created volume successfully. Jul 10 00:45:48 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c4f09059-7ec4-4d64-8c32-1e95aab47e87_m_ovaf87devstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19 Jul 10 00:45:48 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-47aae464-7552-4bc7-8b9e-1e2667548cf8 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "cinder-16110339-6c50-416f-88dc-3ef246a4eb7b-delete_volume" released by "delete_volume" :: held 3.068s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:48 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:48 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e__i71hvlkdevstack@QuobyteHD Jul 10 00:45:48 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a69344cf-40f4-4576-87ad-2fb410517c95 tempest-CreateVolumesFromImageTest-1349383049 None] Acquiring lock "cinder-5d667c1e-f3b5-42d7-8529-5c9936a82a7d-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a69344cf-40f4-4576-87ad-2fb410517c95 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "cinder-5d667c1e-f3b5-42d7-8529-5c9936a82a7d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a69344cf-40f4-4576-87ad-2fb410517c95 tempest-CreateVolumesFromImageTest-1349383049 None] Acquiring lock "cinder-quobyte-5d667c1e-f3b5-42d7-8529-5c9936a82a7d" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a69344cf-40f4-4576-87ad-2fb410517c95 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "cinder-quobyte-5d667c1e-f3b5-42d7-8529-5c9936a82a7d" acquired by "delete_volume" :: waited 0.020s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:49 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a0fd54-1514-4dc4-9e98-d87eeebe4c8e]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a69344cf-40f4-4576-87ad-2fb410517c95 tempest-CreateVolumesFromImageTest-1349383049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d667c1e-f3b5-42d7-8529-5c9936a82a7d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:49 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d667c1e-f3b5-42d7-8529-5c9936a82a7d Jul 10 00:45:49 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:49 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:49 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc 1073741824" returned: 0 in 1.002s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e__i71hvlkdevstack@QuobyteHD" returned: 0 in 0.990s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e__i71hvlkdevstack@QuobyteHD {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:49 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c4f09059-7ec4-4d64-8c32-1e95aab47e87_m_ovaf87devstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19" returned: 0 in 0.934s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:49 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c4f09059-7ec4-4d64-8c32-1e95aab47e87_m_ovaf87devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19 {{(pid=88119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:45:49 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 00:45:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:49 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19 1G Jul 10 00:45:49 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:49 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc Jul 10 00:45:49 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:49 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e__i71hvlkdevstack@QuobyteHD Jul 10 00:45:49 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:50 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a69344cf-40f4-4576-87ad-2fb410517c95 tempest-CreateVolumesFromImageTest-1349383049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d667c1e-f3b5-42d7-8529-5c9936a82a7d" returned: 0 in 0.948s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a69344cf-40f4-4576-87ad-2fb410517c95 tempest-CreateVolumesFromImageTest-1349383049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d667c1e-f3b5-42d7-8529-5c9936a82a7d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:50 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d667c1e-f3b5-42d7-8529-5c9936a82a7d Jul 10 00:45:50 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:50 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc" returned: 0 in 0.732s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:45:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.099s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-886398747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f36200c4-71c2-4344-8c79-3d6ee46bfca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443d3952114443f48efce025f4426fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:45Z,use_quota=True,user_id='80259720603b4b9db2bf0274551f0482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:45:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Creating volume f36200c4-71c2-4344-8c79-3d6ee46bfca3 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:45:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:45:50 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:45:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f36200c4-71c2-4344-8c79-3d6ee46bfca3 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:50 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f36200c4-71c2-4344-8c79-3d6ee46bfca3 1073741824 Jul 10 00:45:50 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24391a56-23b7-4c16-a2db-0f4ea35fd7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5774a273-6d1b-4438-a600-65848ac27bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:50 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19 1G" returned: 0 in 0.839s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:50 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Volume volume-6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc (6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc): created successfully Jul 10 00:45:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5774a273-6d1b-4438-a600-65848ac27bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:50 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Flow 'volume_create_manager' (05b9dc10-6a5e-499a-a1e6-824af742239f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:50 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-96c5536f-0d74-44b0-9b7a-4f378c4dff05 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Created volume successfully. Jul 10 00:45:50 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:50 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d98f812-c32b-47df-a521-5c9a89b46d7e]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e__i71hvlkdevstack@QuobyteHD" returned: 1 in 0.945s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e__i71hvlkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:45:50 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] 1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e was raw, converting to raw {{(pid=88119) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 00:45:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e__i71hvlkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:50 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e__i71hvlkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321 Jul 10 00:45:50 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:50 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19 Jul 10 00:45:50 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:51 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a69344cf-40f4-4576-87ad-2fb410517c95 tempest-CreateVolumesFromImageTest-1349383049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-5d667c1e-f3b5-42d7-8529-5c9936a82a7d" returned: 0 in 0.830s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:51 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a69344cf-40f4-4576-87ad-2fb410517c95 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "cinder-quobyte-5d667c1e-f3b5-42d7-8529-5c9936a82a7d" released by "delete_volume" :: held 1.820s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:51 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-a69344cf-40f4-4576-87ad-2fb410517c95 tempest-CreateVolumesFromImageTest-1349383049 None] Created reservations ['a96be05b-e2ea-4e9d-8a66-efb535f2221b', '34006010-1c5e-41bd-87dd-a8938a275332', 'd458201b-c0a3-4938-90d7-341ed6f144cd', '6192ef33-6da8-4113-aa8c-c290b497aaa8'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:45:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a69344cf-40f4-4576-87ad-2fb410517c95 tempest-CreateVolumesFromImageTest-1349383049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a69344cf-40f4-4576-87ad-2fb410517c95 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a69344cf-40f4-4576-87ad-2fb410517c95 tempest-CreateVolumesFromImageTest-1349383049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a69344cf-40f4-4576-87ad-2fb410517c95 tempest-CreateVolumesFromImageTest-1349383049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a69344cf-40f4-4576-87ad-2fb410517c95 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a69344cf-40f4-4576-87ad-2fb410517c95 tempest-CreateVolumesFromImageTest-1349383049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:51 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:45:51 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:51 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e__i71hvlkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321" returned: 0 in 0.957s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:51 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e__i71hvlkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321 {{(pid=88119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:45:51 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 00:45:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:51 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321 1G Jul 10 00:45:51 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:51 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19" returned: 0 in 1.068s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:51 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f36200c4-71c2-4344-8c79-3d6ee46bfca3 1073741824" returned: 0 in 1.216s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f36200c4-71c2-4344-8c79-3d6ee46bfca3 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:51 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f36200c4-71c2-4344-8c79-3d6ee46bfca3 Jul 10 00:45:51 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:51 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19 Jul 10 00:45:51 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:52 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a69344cf-40f4-4576-87ad-2fb410517c95 tempest-CreateVolumesFromImageTest-1349383049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.133s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:52 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-a69344cf-40f4-4576-87ad-2fb410517c95 tempest-CreateVolumesFromImageTest-1349383049 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:45:52 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-a69344cf-40f4-4576-87ad-2fb410517c95 tempest-CreateVolumesFromImageTest-1349383049 None] Deleted volume successfully. Jul 10 00:45:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a69344cf-40f4-4576-87ad-2fb410517c95 tempest-CreateVolumesFromImageTest-1349383049 None] Lock "cinder-5d667c1e-f3b5-42d7-8529-5c9936a82a7d-delete_volume" released by "delete_volume" :: held 3.334s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:52 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321 1G" returned: 0 in 0.916s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:52 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c936a7d3-0205-4c10-935d-7511c7772cfd]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:52 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f36200c4-71c2-4344-8c79-3d6ee46bfca3" returned: 0 in 0.927s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:52 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] <== create_volume: return (2203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:45:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.209s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.733s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:52 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1162500746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1adfc0e5-7f71-4bc6-991e-351f67330dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443d3952114443f48efce025f4426fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:46Z,use_quota=True,user_id='80259720603b4b9db2bf0274551f0482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:45:52 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Creating volume 1adfc0e5-7f71-4bc6-991e-351f67330dff {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:45:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:52 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:52 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:52 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:45:52 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:45:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1adfc0e5-7f71-4bc6-991e-351f67330dff 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:52 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321 Jul 10 00:45:52 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:52 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1adfc0e5-7f71-4bc6-991e-351f67330dff 1073741824 Jul 10 00:45:52 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ee28be-f01a-428d-9da5-431662d7f6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f36200c4-71c2-4344-8c79-3d6ee46bfca3', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd5f29c-e963-4a42-abc8-c619ad3aa5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:52 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Volume volume-f36200c4-71c2-4344-8c79-3d6ee46bfca3 (f36200c4-71c2-4344-8c79-3d6ee46bfca3): created successfully Jul 10 00:45:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd5f29c-e963-4a42-abc8-c619ad3aa5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Flow 'volume_create_manager' (8767522e-c07b-4878-a25b-a8394be26124) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:53 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-4ec01183-1d94-42eb-945a-72b29c6ad18c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Created volume successfully. Jul 10 00:45:53 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19" returned: 1 in 1.219s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:45:53 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Downloaded image c4f09059-7ec4-4d64-8c32-1e95aab47e87 ((None, [{'url': 'file:///opt/stack/data/glance/images/c4f09059-7ec4-4d64-8c32-1e95aab47e87', 'metadata': {}}])) to volume 237b6929-eea5-40d9-9a91-05000c9e4c19 successfully. {{(pid=88119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 00:45:53 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Temporary image c4f09059-7ec4-4d64-8c32-1e95aab47e87 for user 5be7a7dfb371445c820a30ba1857a365 is deleted. {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 00:45:53 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Marking volume 237b6929-eea5-40d9-9a91-05000c9e4c19 as bootable. {{(pid=88119) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 00:45:53 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Copying metadata from image c4f09059-7ec4-4d64-8c32-1e95aab47e87 to 237b6929-eea5-40d9-9a91-05000c9e4c19. {{(pid=88119) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 00:45:53 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Creating volume glance metadata for volume 237b6929-eea5-40d9-9a91-05000c9e4c19 backed by image c4f09059-7ec4-4d64-8c32-1e95aab47e87 with: {'image_id': 'c4f09059-7ec4-4d64-8c32-1e95aab47e87', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '774d5eef3cb7a3e51e34f715b4280b9c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88119) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 00:45:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7eb0cc4-cff6-44c5-8838-8f540a69af71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-237b6929-eea5-40d9-9a91-05000c9e4c19', 'volume_size': 1, 'image_id': 'c4f09059-7ec4-4d64-8c32-1e95aab47e87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c4f09059-7ec4-4d64-8c32-1e95aab47e87', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '774d5eef3cb7a3e51e34f715b4280b9c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38ff2d2424e941b892685fddf9f8824f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '03530079966186ac7df1caad8df68cd60aa9aac73beb2aa8baaf7ef0a2e2233b33b6927a0cb7baa5daf912e11845df3b3811c3f3634bb09e8a963c60b875ccdb', 'id': 'c4f09059-7ec4-4d64-8c32-1e95aab47e87', 'created_at': datetime.datetime(2026, 7, 9, 22, 45, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 45, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c4f09059-7ec4-4d64-8c32-1e95aab47e87/file', 'properties': {}}, 'image_service': }' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a98fda3e-3811-4cbe-9b9e-f944c0b9c3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:53 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Volume volume-237b6929-eea5-40d9-9a91-05000c9e4c19 (237b6929-eea5-40d9-9a91-05000c9e4c19): created successfully Jul 10 00:45:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a98fda3e-3811-4cbe-9b9e-f944c0b9c3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Flow 'volume_create_manager' (681ad3d8-dc42-497b-a301-c9584f26e743) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:53 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-1055e3d0-8655-41ab-81e8-35a9ab45f788 tempest-VolumeImageDependencyTests-1968093221 None] Created volume successfully. Jul 10 00:45:53 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321" returned: 0 in 0.985s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:53 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321 Jul 10 00:45:53 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:53 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-30167bf5-dfff-4e13-a3b6-e14c554ad61e tempest-VolumeImageDependencyTests-1968093221 None] Acquiring lock "cinder-237b6929-eea5-40d9-9a91-05000c9e4c19-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1adfc0e5-7f71-4bc6-991e-351f67330dff 1073741824" returned: 0 in 1.108s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-30167bf5-dfff-4e13-a3b6-e14c554ad61e tempest-VolumeImageDependencyTests-1968093221 None] Lock "cinder-237b6929-eea5-40d9-9a91-05000c9e4c19-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1adfc0e5-7f71-4bc6-991e-351f67330dff {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-30167bf5-dfff-4e13-a3b6-e14c554ad61e tempest-VolumeImageDependencyTests-1968093221 None] Acquiring lock "cinder-quobyte-237b6929-eea5-40d9-9a91-05000c9e4c19" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-30167bf5-dfff-4e13-a3b6-e14c554ad61e tempest-VolumeImageDependencyTests-1968093221 None] Lock "cinder-quobyte-237b6929-eea5-40d9-9a91-05000c9e4c19" acquired by "delete_volume" :: waited 0.023s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:54 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1adfc0e5-7f71-4bc6-991e-351f67330dff Jul 10 00:45:54 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[492deb84-edbc-4c74-9ca7-0d640a6cd234]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-30167bf5-dfff-4e13-a3b6-e14c554ad61e tempest-VolumeImageDependencyTests-1968093221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:54 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19 Jul 10 00:45:54 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:54 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321" returned: 1 in 1.062s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Downloaded image 1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e ((None, [{'url': 'file:///opt/stack/data/glance/images/1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e', 'metadata': {}}])) to volume 35aea2b9-72d6-438b-a569-c6de4d829321 successfully. {{(pid=88119) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Temporary image 1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e for user 460b458345404841a53788396766abd2 is deleted. {{(pid=88119) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG cinder.volume.volume_utils [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Marking volume 35aea2b9-72d6-438b-a569-c6de4d829321 as bootable. {{(pid=88119) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Copying metadata from image 1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e to 35aea2b9-72d6-438b-a569-c6de4d829321. {{(pid=88119) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Creating volume glance metadata for volume 35aea2b9-72d6-438b-a569-c6de4d829321 backed by image 1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd007b3cdf1d1ce6f5aae78f1599d585d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88119) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 00:45:54 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1adfc0e5-7f71-4bc6-991e-351f67330dff" returned: 0 in 0.822s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] <== create_volume: return (2028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.032s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.112s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-94007449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba08769-5b34-48f5-9266-927f7fc01d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443d3952114443f48efce025f4426fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:47Z,use_quota=True,user_id='80259720603b4b9db2bf0274551f0482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Creating volume 6ba08769-5b34-48f5-9266-927f7fc01d8f {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:45:54 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6ba08769-5b34-48f5-9266-927f7fc01d8f 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3033acd6-2b6a-4648-a3bf-67a03b442e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35aea2b9-72d6-438b-a569-c6de4d829321', 'volume_size': 1, 'image_id': '1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd007b3cdf1d1ce6f5aae78f1599d585d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ef234d3f4b8d445db70f7e43ad8bb75c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e2b9e4fd9eba8dea2c2076b8de775b8405d1148e1ffae82bf93c202af97fe355467feaca80c53290695aca4e36945111ee1bbf05cd072c47d5ee25afeb47f5d1', 'id': '1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e', 'created_at': datetime.datetime(2026, 7, 9, 22, 45, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 22, 45, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1259ec1d-aee4-4b30-8c6c-5f2a2ef38c6e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f93722cb-198a-4490-b621-347c26f22c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:54 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6ba08769-5b34-48f5-9266-927f7fc01d8f 1073741824 Jul 10 00:45:54 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a8fbb52-6492-41eb-b721-ed79435a9b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1adfc0e5-7f71-4bc6-991e-351f67330dff', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f996ef-582f-4543-b02a-42261388cc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:54 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Volume volume-35aea2b9-72d6-438b-a569-c6de4d829321 (35aea2b9-72d6-438b-a569-c6de4d829321): created successfully Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f93722cb-198a-4490-b621-347c26f22c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Flow 'volume_create_manager' (82305f77-73d6-4ead-8adc-c040cdde0afa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:54 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Volume volume-1adfc0e5-7f71-4bc6-991e-351f67330dff (1adfc0e5-7f71-4bc6-991e-351f67330dff): created successfully Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f996ef-582f-4543-b02a-42261388cc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:54 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Flow 'volume_create_manager' (76c2c9e6-be6a-4a74-a6ff-26c847c4a8b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:55 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-11f13e34-b703-4fab-8e3f-9624fc9b540d tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Created volume successfully. Jul 10 00:45:55 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-964eafe7-54a9-48fc-aa55-a4a76e47da72 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Created volume successfully. Jul 10 00:45:55 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-30167bf5-dfff-4e13-a3b6-e14c554ad61e tempest-VolumeImageDependencyTests-1968093221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19" returned: 0 in 1.043s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-30167bf5-dfff-4e13-a3b6-e14c554ad61e tempest-VolumeImageDependencyTests-1968093221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:55 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19 Jul 10 00:45:55 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:55 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:45:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Flow 'volume_create_manager' (ce0d81ff-8e55-4c93-8f5a-68cbc22675ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e794e9-717f-4f64-b1e5-3da7251b96fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e794e9-717f-4f64-b1e5-3da7251b96fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1450881006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a96dd062-bbbf-4be7-9ed5-a9d63f3c932f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a5739239c3442fb9a26935997ba85f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:55Z,use_quota=True,user_id='5b912297abfc4b1b92a605510c7f434f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f45e869-18ce-44bc-a97d-c98284d5e5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f45e869-18ce-44bc-a97d-c98284d5e5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3aecc38-94a1-4b79-adb7-ab6062128dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3aecc38-94a1-4b79-adb7-ab6062128dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a96dd062-bbbf-4be7-9ed5-a9d63f3c932f', 'volume_name': 'volume-a96dd062-bbbf-4be7-9ed5-a9d63f3c932f', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ea5a53-15fd-48a4-9fd9-0e15773e0211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ea5a53-15fd-48a4-9fd9-0e15773e0211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:55 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0cf6014-2183-461d-ab2d-5ac17a4b25de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:55 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Volume a96dd062-bbbf-4be7-9ed5-a9d63f3c932f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a96dd062-bbbf-4be7-9ed5-a9d63f3c932f', 'volume_size': 1} Jul 10 00:45:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:55 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6ba08769-5b34-48f5-9266-927f7fc01d8f 1073741824" returned: 0 in 0.994s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6ba08769-5b34-48f5-9266-927f7fc01d8f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:55 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6ba08769-5b34-48f5-9266-927f7fc01d8f Jul 10 00:45:55 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:56 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-30167bf5-dfff-4e13-a3b6-e14c554ad61e tempest-VolumeImageDependencyTests-1968093221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19" returned: 1 in 0.917s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-30167bf5-dfff-4e13-a3b6-e14c554ad61e tempest-VolumeImageDependencyTests-1968093221 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-30167bf5-dfff-4e13-a3b6-e14c554ad61e tempest-VolumeImageDependencyTests-1968093221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:56 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19 Jul 10 00:45:56 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d571a033-40c6-4094-a9b6-2aca91584371 tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Acquiring lock "cinder-35aea2b9-72d6-438b-a569-c6de4d829321-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d571a033-40c6-4094-a9b6-2aca91584371 tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Lock "cinder-35aea2b9-72d6-438b-a569-c6de4d829321-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d571a033-40c6-4094-a9b6-2aca91584371 tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Acquiring lock "cinder-quobyte-35aea2b9-72d6-438b-a569-c6de4d829321" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d571a033-40c6-4094-a9b6-2aca91584371 tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Lock "cinder-quobyte-35aea2b9-72d6-438b-a569-c6de4d829321" acquired by "delete_volume" :: waited 0.024s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f14db72-7618-4d5c-9722-78c45fd3c7b0]: (4, 'raw') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d571a033-40c6-4094-a9b6-2aca91584371 tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:56 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321 Jul 10 00:45:56 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:56 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6ba08769-5b34-48f5-9266-927f7fc01d8f" returned: 0 in 0.685s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.984s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1450881006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a96dd062-bbbf-4be7-9ed5-a9d63f3c932f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a5739239c3442fb9a26935997ba85f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:45:55Z,use_quota=True,user_id='5b912297abfc4b1b92a605510c7f434f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Creating volume a96dd062-bbbf-4be7-9ed5-a9d63f3c932f {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:45:56 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a96dd062-bbbf-4be7-9ed5-a9d63f3c932f 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:56 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a96dd062-bbbf-4be7-9ed5-a9d63f3c932f 1073741824 Jul 10 00:45:56 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62e8454c-3ee8-42ac-93c0-b24aa279c908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ba08769-5b34-48f5-9266-927f7fc01d8f', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed87aeb6-706a-41b6-afe7-cb35f9dd1324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:56 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Volume volume-6ba08769-5b34-48f5-9266-927f7fc01d8f (6ba08769-5b34-48f5-9266-927f7fc01d8f): created successfully Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed87aeb6-706a-41b6-afe7-cb35f9dd1324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Flow 'volume_create_manager' (baaeef05-0069-4734-9976-75740b183bea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:56 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-28d97630-7688-4263-afd5-750bf04f91d9 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Created volume successfully. Jul 10 00:45:56 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-30167bf5-dfff-4e13-a3b6-e14c554ad61e tempest-VolumeImageDependencyTests-1968093221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-237b6929-eea5-40d9-9a91-05000c9e4c19" returned: 0 in 0.777s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:56 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-30167bf5-dfff-4e13-a3b6-e14c554ad61e tempest-VolumeImageDependencyTests-1968093221 None] Lock "cinder-quobyte-237b6929-eea5-40d9-9a91-05000c9e4c19" released by "delete_volume" :: held 2.828s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:57 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-30167bf5-dfff-4e13-a3b6-e14c554ad61e tempest-VolumeImageDependencyTests-1968093221 None] Created reservations ['d7510e72-fe72-4fbe-85d1-fb6e7c2b0a16', '8f2e1ae2-ee08-41b4-a55c-21fadb91ba3e', '1110b959-dfea-46af-b737-6415ce5baf6e', 'e6c910b1-a16b-4b11-af61-6415b3ab2a2a'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:45:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-30167bf5-dfff-4e13-a3b6-e14c554ad61e tempest-VolumeImageDependencyTests-1968093221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-30167bf5-dfff-4e13-a3b6-e14c554ad61e tempest-VolumeImageDependencyTests-1968093221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:57 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-30167bf5-dfff-4e13-a3b6-e14c554ad61e tempest-VolumeImageDependencyTests-1968093221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:57 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-30167bf5-dfff-4e13-a3b6-e14c554ad61e tempest-VolumeImageDependencyTests-1968093221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-30167bf5-dfff-4e13-a3b6-e14c554ad61e tempest-VolumeImageDependencyTests-1968093221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-30167bf5-dfff-4e13-a3b6-e14c554ad61e tempest-VolumeImageDependencyTests-1968093221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:57 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:45:57 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:57 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d571a033-40c6-4094-a9b6-2aca91584371 tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321" returned: 0 in 0.871s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d571a033-40c6-4094-a9b6-2aca91584371 tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:57 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321 Jul 10 00:45:57 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:57 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a96dd062-bbbf-4be7-9ed5-a9d63f3c932f 1073741824" returned: 0 in 1.058s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a96dd062-bbbf-4be7-9ed5-a9d63f3c932f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:57 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a96dd062-bbbf-4be7-9ed5-a9d63f3c932f Jul 10 00:45:57 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:57 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-30167bf5-dfff-4e13-a3b6-e14c554ad61e tempest-VolumeImageDependencyTests-1968093221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.834s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:57 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-30167bf5-dfff-4e13-a3b6-e14c554ad61e tempest-VolumeImageDependencyTests-1968093221 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:45:57 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-30167bf5-dfff-4e13-a3b6-e14c554ad61e tempest-VolumeImageDependencyTests-1968093221 None] Deleted volume successfully. Jul 10 00:45:57 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-30167bf5-dfff-4e13-a3b6-e14c554ad61e tempest-VolumeImageDependencyTests-1968093221 None] Lock "cinder-237b6929-eea5-40d9-9a91-05000c9e4c19-delete_volume" released by "delete_volume" :: held 3.989s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:58 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-26f0843d-76d0-4d9b-985c-f8e32bd65a1c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "cinder-6ba08769-5b34-48f5-9266-927f7fc01d8f-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:58 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-26f0843d-76d0-4d9b-985c-f8e32bd65a1c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-6ba08769-5b34-48f5-9266-927f7fc01d8f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:58 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-26f0843d-76d0-4d9b-985c-f8e32bd65a1c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "cinder-quobyte-6ba08769-5b34-48f5-9266-927f7fc01d8f" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:45:58 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-26f0843d-76d0-4d9b-985c-f8e32bd65a1c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-quobyte-6ba08769-5b34-48f5-9266-927f7fc01d8f" acquired by "delete_volume" :: waited 0.021s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:45:58 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:58 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0848fe7d-27a5-4bf3-b27f-1b6ff2413fe7]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:45:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-26f0843d-76d0-4d9b-985c-f8e32bd65a1c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6ba08769-5b34-48f5-9266-927f7fc01d8f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d571a033-40c6-4094-a9b6-2aca91584371 tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321" returned: 1 in 1.004s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d571a033-40c6-4094-a9b6-2aca91584371 tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321' failed. Not Retrying. {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 00:45:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d571a033-40c6-4094-a9b6-2aca91584371 tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:58 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321 Jul 10 00:45:58 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:58 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6ba08769-5b34-48f5-9266-927f7fc01d8f Jul 10 00:45:58 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:58 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a96dd062-bbbf-4be7-9ed5-a9d63f3c932f" returned: 0 in 1.127s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] <== create_volume: return (2244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:45:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.247s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:58 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0cf6014-2183-461d-ab2d-5ac17a4b25de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a96dd062-bbbf-4be7-9ed5-a9d63f3c932f', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:58 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b87329-b070-4b9b-8a10-ae464822d162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:45:58 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Volume volume-a96dd062-bbbf-4be7-9ed5-a9d63f3c932f (a96dd062-bbbf-4be7-9ed5-a9d63f3c932f): created successfully Jul 10 00:45:58 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b87329-b070-4b9b-8a10-ae464822d162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:45:58 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Flow 'volume_create_manager' (ce0d81ff-8e55-4c93-8f5a-68cbc22675ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:45:58 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-323b3de1-a8fb-41d3-89fe-eeb1c0aea052 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Created volume successfully. Jul 10 00:45:59 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d571a033-40c6-4094-a9b6-2aca91584371 tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-35aea2b9-72d6-438b-a569-c6de4d829321" returned: 0 in 0.837s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d571a033-40c6-4094-a9b6-2aca91584371 tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Lock "cinder-quobyte-35aea2b9-72d6-438b-a569-c6de4d829321" released by "delete_volume" :: held 2.781s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:45:59 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-d571a033-40c6-4094-a9b6-2aca91584371 tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Created reservations ['43435e3d-9d31-49fb-834a-0c5a2844d9d7', 'a06db68b-40fd-4bc0-8be9-754d6f83ad5b', 'c8b9eb4b-2b79-4ac6-bed0-5de02d1623fc', 'c454bbde-0eeb-491b-a198-966760829057'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:45:59 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Jul 10 00:45:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-26f0843d-76d0-4d9b-985c-f8e32bd65a1c tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6ba08769-5b34-48f5-9266-927f7fc01d8f" returned: 0 in 1.013s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:45:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-26f0843d-76d0-4d9b-985c-f8e32bd65a1c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6ba08769-5b34-48f5-9266-927f7fc01d8f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d571a033-40c6-4094-a9b6-2aca91584371 tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:45:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d571a033-40c6-4094-a9b6-2aca91584371 tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:45:59 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6ba08769-5b34-48f5-9266-927f7fc01d8f Jul 10 00:45:59 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d571a033-40c6-4094-a9b6-2aca91584371 tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:45:59 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:59 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d571a033-40c6-4094-a9b6-2aca91584371 tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:45:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d571a033-40c6-4094-a9b6-2aca91584371 tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:45:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d571a033-40c6-4094-a9b6-2aca91584371 tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:45:59 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:45:59 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:45:59 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d571a033-40c6-4094-a9b6-2aca91584371 tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.761s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-d571a033-40c6-4094-a9b6-2aca91584371 tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:00 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-d571a033-40c6-4094-a9b6-2aca91584371 tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Deleted volume successfully. Jul 10 00:46:00 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-26f0843d-76d0-4d9b-985c-f8e32bd65a1c tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6ba08769-5b34-48f5-9266-927f7fc01d8f" returned: 0 in 0.854s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d571a033-40c6-4094-a9b6-2aca91584371 tempest-VolumeAndVolumeTypeFromImageTest-1593920631 None] Lock "cinder-35aea2b9-72d6-438b-a569-c6de4d829321-delete_volume" released by "delete_volume" :: held 3.866s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-26f0843d-76d0-4d9b-985c-f8e32bd65a1c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-quobyte-6ba08769-5b34-48f5-9266-927f7fc01d8f" released by "delete_volume" :: held 1.925s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-26f0843d-76d0-4d9b-985c-f8e32bd65a1c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Created reservations ['cc2ceec5-c474-49ed-9c15-f5cf4952404d', '09b27c0e-bc25-481c-842d-10d980a4f95c', '0966e4a5-6fa4-4116-9c78-18b86a71e007', 'c1375e1a-d9d6-477a-b6b3-1dc39f99669b'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-26f0843d-76d0-4d9b-985c-f8e32bd65a1c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-26f0843d-76d0-4d9b-985c-f8e32bd65a1c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-26f0843d-76d0-4d9b-985c-f8e32bd65a1c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-26f0843d-76d0-4d9b-985c-f8e32bd65a1c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-26f0843d-76d0-4d9b-985c-f8e32bd65a1c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-26f0843d-76d0-4d9b-985c-f8e32bd65a1c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:00 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:46:00 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-249497fb-6b15-41ef-9ed3-49a212a9cdcc tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "cinder-1adfc0e5-7f71-4bc6-991e-351f67330dff-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-249497fb-6b15-41ef-9ed3-49a212a9cdcc tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-1adfc0e5-7f71-4bc6-991e-351f67330dff-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-249497fb-6b15-41ef-9ed3-49a212a9cdcc tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "cinder-quobyte-1adfc0e5-7f71-4bc6-991e-351f67330dff" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-249497fb-6b15-41ef-9ed3-49a212a9cdcc tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-quobyte-1adfc0e5-7f71-4bc6-991e-351f67330dff" acquired by "delete_volume" :: waited 0.035s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c68e55e-dd6d-4fd7-9664-5530898c2096]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-249497fb-6b15-41ef-9ed3-49a212a9cdcc tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1adfc0e5-7f71-4bc6-991e-351f67330dff {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Flow 'volume_create_manager' (6055bb09-e9f3-4868-a576-36fb1eba4455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64ff419-d52e-4001-84ab-32e1fff428c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64ff419-d52e-4001-84ab-32e1fff428c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-825568759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0035d14-32d2-415e-898f-54c5ecfcc09d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a5739239c3442fb9a26935997ba85f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:01Z,use_quota=True,user_id='5b912297abfc4b1b92a605510c7f434f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5758eb34-9341-4e1d-a365-24f075b4e1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5758eb34-9341-4e1d-a365-24f075b4e1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b5ae45-7956-40f0-b924-c4f89ebc226c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b5ae45-7956-40f0-b924-c4f89ebc226c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0035d14-32d2-415e-898f-54c5ecfcc09d', 'volume_name': 'volume-b0035d14-32d2-415e-898f-54c5ecfcc09d', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f382be-bc4a-480c-b738-b5239cb6ec76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f382be-bc4a-480c-b738-b5239cb6ec76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f0e579a-d1db-4983-a2ec-b9b1b5dc8af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:00 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Volume b0035d14-32d2-415e-898f-54c5ecfcc09d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0035d14-32d2-415e-898f-54c5ecfcc09d', 'volume_size': 1} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-825568759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0035d14-32d2-415e-898f-54c5ecfcc09d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a5739239c3442fb9a26935997ba85f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:01Z,use_quota=True,user_id='5b912297abfc4b1b92a605510c7f434f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Creating volume b0035d14-32d2-415e-898f-54c5ecfcc09d {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:46:00 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:46:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0035d14-32d2-415e-898f-54c5ecfcc09d 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:00 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0035d14-32d2-415e-898f-54c5ecfcc09d 1073741824 Jul 10 00:46:00 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:00 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1adfc0e5-7f71-4bc6-991e-351f67330dff Jul 10 00:46:00 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:01 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:46:01 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Flow 'volume_create_manager' (679da80e-a379-4291-a8f4-f8de245f12b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:01 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ada92f-e675-4e04-8cf9-aada8a5fa4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:01 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ada92f-e675-4e04-8cf9-aada8a5fa4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1860217299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d468eb6e-7b0b-4f8e-8e5f-1132f491838b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a5739239c3442fb9a26935997ba85f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:01Z,use_quota=True,user_id='5b912297abfc4b1b92a605510c7f434f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:01 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469a8c3e-c505-4976-b09b-62b5de34adad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:01 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469a8c3e-c505-4976-b09b-62b5de34adad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:01 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a55b73aa-90f3-48d2-aad8-0275e8b32647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:01 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a55b73aa-90f3-48d2-aad8-0275e8b32647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd468eb6e-7b0b-4f8e-8e5f-1132f491838b', 'volume_name': 'volume-d468eb6e-7b0b-4f8e-8e5f-1132f491838b', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:01 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f61e8763-81b9-4704-80b0-3de47749ba5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:01 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f61e8763-81b9-4704-80b0-3de47749ba5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:01 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26e4988-a840-4f59-8dcc-57c264fb2c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:01 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Volume d468eb6e-7b0b-4f8e-8e5f-1132f491838b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d468eb6e-7b0b-4f8e-8e5f-1132f491838b', 'volume_size': 1} Jul 10 00:46:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:01 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-26f0843d-76d0-4d9b-985c-f8e32bd65a1c tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.416s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:01 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-26f0843d-76d0-4d9b-985c-f8e32bd65a1c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:01 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-26f0843d-76d0-4d9b-985c-f8e32bd65a1c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Deleted volume successfully. Jul 10 00:46:01 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-26f0843d-76d0-4d9b-985c-f8e32bd65a1c tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-6ba08769-5b34-48f5-9266-927f7fc01d8f-delete_volume" released by "delete_volume" :: held 3.687s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:01 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-249497fb-6b15-41ef-9ed3-49a212a9cdcc tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1adfc0e5-7f71-4bc6-991e-351f67330dff" returned: 0 in 1.346s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-249497fb-6b15-41ef-9ed3-49a212a9cdcc tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1adfc0e5-7f71-4bc6-991e-351f67330dff {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:02 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1adfc0e5-7f71-4bc6-991e-351f67330dff Jul 10 00:46:02 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:02 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:46:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Flow 'volume_create_manager' (8e01e045-2c01-4f0d-85f9-18bf4cb3cfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3db2095-20f6-4b5a-bced-a60518a1de93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3db2095-20f6-4b5a-bced-a60518a1de93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1200718767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a5739239c3442fb9a26935997ba85f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:02Z,use_quota=True,user_id='5b912297abfc4b1b92a605510c7f434f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3377721a-af72-4061-95bb-862a3cd21fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3377721a-af72-4061-95bb-862a3cd21fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e3f1a2-f62b-4f7a-88a8-d958cc91bf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e3f1a2-f62b-4f7a-88a8-d958cc91bf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7', 'volume_name': 'volume-7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9025e7a8-5ac3-494f-8029-dff3b4aae807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9025e7a8-5ac3-494f-8029-dff3b4aae807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa1358d-9eb9-44ac-9bb7-ed43462b4a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:02 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Volume 7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7', 'volume_size': 1} Jul 10 00:46:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:02 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0035d14-32d2-415e-898f-54c5ecfcc09d 1073741824" returned: 0 in 1.806s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0035d14-32d2-415e-898f-54c5ecfcc09d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:02 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0035d14-32d2-415e-898f-54c5ecfcc09d Jul 10 00:46:02 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:02 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:46:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Flow 'volume_create_manager' (3389c2fe-4fe4-446e-ab61-6e24e00ee815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e187ab6-9575-4653-8cb9-46a89c4f1bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e187ab6-9575-4653-8cb9-46a89c4f1bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1758250168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b8773b8-d0cd-40ca-8f14-9d3f6414e558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a5739239c3442fb9a26935997ba85f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:03Z,use_quota=True,user_id='5b912297abfc4b1b92a605510c7f434f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b82ca8-a33a-4687-82da-edb997604670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b82ca8-a33a-4687-82da-edb997604670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701b2bf7-a2cb-4876-ad99-f7ca6281c3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701b2bf7-a2cb-4876-ad99-f7ca6281c3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b8773b8-d0cd-40ca-8f14-9d3f6414e558', 'volume_name': 'volume-9b8773b8-d0cd-40ca-8f14-9d3f6414e558', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d84824f-9cbe-4b94-95f4-477f032a8408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d84824f-9cbe-4b94-95f4-477f032a8408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe747b0b-7897-4265-8a4e-9ad53c6608cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:03 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Volume 9b8773b8-d0cd-40ca-8f14-9d3f6414e558: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b8773b8-d0cd-40ca-8f14-9d3f6414e558', 'volume_size': 1} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:03 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-249497fb-6b15-41ef-9ed3-49a212a9cdcc tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1adfc0e5-7f71-4bc6-991e-351f67330dff" returned: 0 in 1.128s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-249497fb-6b15-41ef-9ed3-49a212a9cdcc tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-quobyte-1adfc0e5-7f71-4bc6-991e-351f67330dff" released by "delete_volume" :: held 2.566s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-249497fb-6b15-41ef-9ed3-49a212a9cdcc tempest-CreateVolumesFromSnapshotTest-1043600788 None] Created reservations ['36a95100-fd29-4c22-ba56-d67634f71817', '19ccde19-9a42-4327-9a8e-ea14438c5533', '85c159b7-788e-4ec5-ba27-627428cda2df', 'beeab05c-0383-4820-8dda-09bab16b5d2b'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-249497fb-6b15-41ef-9ed3-49a212a9cdcc tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-249497fb-6b15-41ef-9ed3-49a212a9cdcc tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-249497fb-6b15-41ef-9ed3-49a212a9cdcc tempest-CreateVolumesFromSnapshotTest-1043600788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-249497fb-6b15-41ef-9ed3-49a212a9cdcc tempest-CreateVolumesFromSnapshotTest-1043600788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-249497fb-6b15-41ef-9ed3-49a212a9cdcc tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-249497fb-6b15-41ef-9ed3-49a212a9cdcc tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Flow 'volume_create_manager' (75e38b07-1e36-4187-8030-c80af9fe3ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:03 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:46:03 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf0591b-702e-4743-b99d-b02346adb793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf0591b-702e-4743-b99d-b02346adb793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-106851330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7beac152-3d81-4860-b506-5079dddc3230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a5739239c3442fb9a26935997ba85f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:03Z,use_quota=True,user_id='5b912297abfc4b1b92a605510c7f434f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba65193-ac13-4a86-8311-d9a025ccfe36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba65193-ac13-4a86-8311-d9a025ccfe36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b1f2a56-673c-4ecb-8ee1-098252c95c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b1f2a56-673c-4ecb-8ee1-098252c95c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7beac152-3d81-4860-b506-5079dddc3230', 'volume_name': 'volume-7beac152-3d81-4860-b506-5079dddc3230', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:03 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549533b3-49ec-405b-bf53-acfb65417c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549533b3-49ec-405b-bf53-acfb65417c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6e8658-0f5c-43e3-b1d7-6f1e2309c2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:03 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Volume 7beac152-3d81-4860-b506-5079dddc3230: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7beac152-3d81-4860-b506-5079dddc3230', 'volume_size': 1} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0035d14-32d2-415e-898f-54c5ecfcc09d" returned: 0 in 0.911s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] <== create_volume: return (2787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.791s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.094s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1860217299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d468eb6e-7b0b-4f8e-8e5f-1132f491838b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a5739239c3442fb9a26935997ba85f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:01Z,use_quota=True,user_id='5b912297abfc4b1b92a605510c7f434f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Creating volume d468eb6e-7b0b-4f8e-8e5f-1132f491838b {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:46:03 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d468eb6e-7b0b-4f8e-8e5f-1132f491838b 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f0e579a-d1db-4983-a2ec-b9b1b5dc8af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0035d14-32d2-415e-898f-54c5ecfcc09d', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:03 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d468eb6e-7b0b-4f8e-8e5f-1132f491838b 1073741824 Jul 10 00:46:03 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c55a314-12d7-4c76-9a9c-5dfde89d2ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:03 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Volume volume-b0035d14-32d2-415e-898f-54c5ecfcc09d (b0035d14-32d2-415e-898f-54c5ecfcc09d): created successfully Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c55a314-12d7-4c76-9a9c-5dfde89d2ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Flow 'volume_create_manager' (6055bb09-e9f3-4868-a576-36fb1eba4455) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:03 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-3a6bddab-772a-4339-b7ba-aab6a6940d0b tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Created volume successfully. Jul 10 00:46:04 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-249497fb-6b15-41ef-9ed3-49a212a9cdcc tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.866s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:04 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-249497fb-6b15-41ef-9ed3-49a212a9cdcc tempest-CreateVolumesFromSnapshotTest-1043600788 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:04 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-249497fb-6b15-41ef-9ed3-49a212a9cdcc tempest-CreateVolumesFromSnapshotTest-1043600788 None] Deleted volume successfully. Jul 10 00:46:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-249497fb-6b15-41ef-9ed3-49a212a9cdcc tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-1adfc0e5-7f71-4bc6-991e-351f67330dff-delete_volume" released by "delete_volume" :: held 3.878s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-109986f7-7b85-4d6a-ad4f-ad81f4c92ffb tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "cinder-f36200c4-71c2-4344-8c79-3d6ee46bfca3-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-109986f7-7b85-4d6a-ad4f-ad81f4c92ffb tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-f36200c4-71c2-4344-8c79-3d6ee46bfca3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-109986f7-7b85-4d6a-ad4f-ad81f4c92ffb tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "cinder-quobyte-f36200c4-71c2-4344-8c79-3d6ee46bfca3" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-109986f7-7b85-4d6a-ad4f-ad81f4c92ffb tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-quobyte-f36200c4-71c2-4344-8c79-3d6ee46bfca3" acquired by "delete_volume" :: waited 0.030s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:04 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[82da6856-eed9-45bf-adb0-01d46ff262f3]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-109986f7-7b85-4d6a-ad4f-ad81f4c92ffb tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f36200c4-71c2-4344-8c79-3d6ee46bfca3 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:04 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f36200c4-71c2-4344-8c79-3d6ee46bfca3 Jul 10 00:46:04 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:04 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d468eb6e-7b0b-4f8e-8e5f-1132f491838b 1073741824" returned: 0 in 1.131s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d468eb6e-7b0b-4f8e-8e5f-1132f491838b {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:04 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d468eb6e-7b0b-4f8e-8e5f-1132f491838b Jul 10 00:46:04 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:05 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-109986f7-7b85-4d6a-ad4f-ad81f4c92ffb tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f36200c4-71c2-4344-8c79-3d6ee46bfca3" returned: 0 in 0.850s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-109986f7-7b85-4d6a-ad4f-ad81f4c92ffb tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f36200c4-71c2-4344-8c79-3d6ee46bfca3 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:05 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f36200c4-71c2-4344-8c79-3d6ee46bfca3 Jul 10 00:46:05 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:05 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d468eb6e-7b0b-4f8e-8e5f-1132f491838b" returned: 0 in 0.913s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] <== create_volume: return (2100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:46:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.105s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.270s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1200718767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a5739239c3442fb9a26935997ba85f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:02Z,use_quota=True,user_id='5b912297abfc4b1b92a605510c7f434f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:46:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Creating volume 7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:46:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:46:05 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:46:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:05 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7 1073741824 Jul 10 00:46:05 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26e4988-a840-4f59-8dcc-57c264fb2c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d468eb6e-7b0b-4f8e-8e5f-1132f491838b', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:05 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:05 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da14d0de-eab9-45e2-a7cc-2aea3cfb6eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:05 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Volume volume-d468eb6e-7b0b-4f8e-8e5f-1132f491838b (d468eb6e-7b0b-4f8e-8e5f-1132f491838b): created successfully Jul 10 00:46:05 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da14d0de-eab9-45e2-a7cc-2aea3cfb6eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:05 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Flow 'volume_create_manager' (679da80e-a379-4291-a8f4-f8de245f12b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:05 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-b3ec84d1-fb0d-454c-b9cf-a5fafeb67286 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Created volume successfully. Jul 10 00:46:06 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-109986f7-7b85-4d6a-ad4f-ad81f4c92ffb tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-f36200c4-71c2-4344-8c79-3d6ee46bfca3" returned: 0 in 0.928s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:06 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-109986f7-7b85-4d6a-ad4f-ad81f4c92ffb tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-quobyte-f36200c4-71c2-4344-8c79-3d6ee46bfca3" released by "delete_volume" :: held 1.823s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:06 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-109986f7-7b85-4d6a-ad4f-ad81f4c92ffb tempest-CreateVolumesFromSnapshotTest-1043600788 None] Created reservations ['e378d77a-8c49-4b2c-a855-0ad3322cc889', '947b2f18-6241-4b3e-bd2b-7d7e6ea319f8', 'e9a0b1f1-2707-4ec4-9219-749fa39597a9', '7aff4ff2-ee15-43c3-82d5-0041b27965d4'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-109986f7-7b85-4d6a-ad4f-ad81f4c92ffb tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-109986f7-7b85-4d6a-ad4f-ad81f4c92ffb tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:06 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-109986f7-7b85-4d6a-ad4f-ad81f4c92ffb tempest-CreateVolumesFromSnapshotTest-1043600788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:06 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-109986f7-7b85-4d6a-ad4f-ad81f4c92ffb tempest-CreateVolumesFromSnapshotTest-1043600788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-109986f7-7b85-4d6a-ad4f-ad81f4c92ffb tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-109986f7-7b85-4d6a-ad4f-ad81f4c92ffb tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:06 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:46:06 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:06 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-09b3fb96-3d5b-4def-8eab-b1d6b5f84547 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "cinder-6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:06 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-09b3fb96-3d5b-4def-8eab-b1d6b5f84547 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-09b3fb96-3d5b-4def-8eab-b1d6b5f84547 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "cinder-quobyte-6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-09b3fb96-3d5b-4def-8eab-b1d6b5f84547 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-quobyte-6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc" acquired by "delete_volume" :: waited 0.020s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:07 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7 1073741824" returned: 0 in 1.320s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[40da172b-883a-49ea-ac2e-8d77d928312b]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-09b3fb96-3d5b-4def-8eab-b1d6b5f84547 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:07 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7 Jul 10 00:46:07 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Flow 'volume_create_manager' (e418b4f6-64f8-4b4e-a0b8-acb56402c818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (892eee09-c965-4b3e-bc9a-fb3848e2052a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:07 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc Jul 10 00:46:07 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (892eee09-c965-4b3e-bc9a-fb3848e2052a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b38c79b-69ba-4246-8e54-c09b6cac0820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a530ddf47a694c4a8975accdf45ea406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:07Z,use_quota=True,user_id='276c18320ad44716a6f4a93fb6ff2d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (056c9325-17b1-4f7a-8abc-8c49deaa42a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (056c9325-17b1-4f7a-8abc-8c49deaa42a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c708ca52-7366-461e-9762-9c345a1509b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c708ca52-7366-461e-9762-9c345a1509b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b38c79b-69ba-4246-8e54-c09b6cac0820', 'volume_name': 'volume-9b38c79b-69ba-4246-8e54-c09b6cac0820', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (519ab994-b227-487e-82cd-cf783d496d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (519ab994-b227-487e-82cd-cf783d496d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95240b0c-b472-478c-b311-7195ab4c1b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:07 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Volume 9b38c79b-69ba-4246-8e54-c09b6cac0820: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b38c79b-69ba-4246-8e54-c09b6cac0820', 'volume_size': 1} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:07 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-109986f7-7b85-4d6a-ad4f-ad81f4c92ffb tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.818s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-109986f7-7b85-4d6a-ad4f-ad81f4c92ffb tempest-CreateVolumesFromSnapshotTest-1043600788 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:07 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-109986f7-7b85-4d6a-ad4f-ad81f4c92ffb tempest-CreateVolumesFromSnapshotTest-1043600788 None] Deleted volume successfully. Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-109986f7-7b85-4d6a-ad4f-ad81f4c92ffb tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-f36200c4-71c2-4344-8c79-3d6ee46bfca3-delete_volume" released by "delete_volume" :: held 3.060s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:07 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7" returned: 0 in 0.769s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] <== create_volume: return (2170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.172s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.777s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1758250168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b8773b8-d0cd-40ca-8f14-9d3f6414e558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a5739239c3442fb9a26935997ba85f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:03Z,use_quota=True,user_id='5b912297abfc4b1b92a605510c7f434f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Creating volume 9b8773b8-d0cd-40ca-8f14-9d3f6414e558 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:46:07 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9b8773b8-d0cd-40ca-8f14-9d3f6414e558 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa1358d-9eb9-44ac-9bb7-ed43462b4a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:07 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9b8773b8-d0cd-40ca-8f14-9d3f6414e558 1073741824 Jul 10 00:46:07 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ead0bf-4f99-4611-89a4-a23bdae51c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:07 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Volume volume-7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7 (7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7): created successfully Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ead0bf-4f99-4611-89a4-a23bdae51c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Flow 'volume_create_manager' (8e01e045-2c01-4f0d-85f9-18bf4cb3cfc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:07 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-770bb9b4-c1fa-4c34-8654-b20ccf63dbd5 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Created volume successfully. Jul 10 00:46:07 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-09b3fb96-3d5b-4def-8eab-b1d6b5f84547 tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc" returned: 0 in 0.936s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-09b3fb96-3d5b-4def-8eab-b1d6b5f84547 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:08 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc Jul 10 00:46:08 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:08 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-09b3fb96-3d5b-4def-8eab-b1d6b5f84547 tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc" returned: 0 in 0.750s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-09b3fb96-3d5b-4def-8eab-b1d6b5f84547 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-quobyte-6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc" released by "delete_volume" :: held 1.737s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:08 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-09b3fb96-3d5b-4def-8eab-b1d6b5f84547 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Created reservations ['6fab0ae6-b1a4-486c-80fe-c30710007fc2', '50b994d1-adf2-4c27-ba39-d503f2dc259d', '1243b9ff-84eb-4a8e-bc2a-74254b9c6ec1', 'f5cbf43a-4c65-4c71-99eb-017a67959e2b'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:08 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9b8773b8-d0cd-40ca-8f14-9d3f6414e558 1073741824" returned: 0 in 0.994s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-09b3fb96-3d5b-4def-8eab-b1d6b5f84547 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-09b3fb96-3d5b-4def-8eab-b1d6b5f84547 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-09b3fb96-3d5b-4def-8eab-b1d6b5f84547 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-09b3fb96-3d5b-4def-8eab-b1d6b5f84547 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-09b3fb96-3d5b-4def-8eab-b1d6b5f84547 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-09b3fb96-3d5b-4def-8eab-b1d6b5f84547 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:08 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:46:08 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9b8773b8-d0cd-40ca-8f14-9d3f6414e558 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:08 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9b8773b8-d0cd-40ca-8f14-9d3f6414e558 Jul 10 00:46:08 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:09 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-debb165d-016a-449b-8963-775f2c88e0ff tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "cinder-a1156cef-c5e5-45bf-852a-fb093cabde07-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:09 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-debb165d-016a-449b-8963-775f2c88e0ff tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-a1156cef-c5e5-45bf-852a-fb093cabde07-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:09 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-debb165d-016a-449b-8963-775f2c88e0ff tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "cinder-quobyte-a1156cef-c5e5-45bf-852a-fb093cabde07" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:09 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-debb165d-016a-449b-8963-775f2c88e0ff tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-quobyte-a1156cef-c5e5-45bf-852a-fb093cabde07" acquired by "delete_volume" :: waited 0.026s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:09 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65211aa-bc54-4ef4-ba5e-54a844cf7529]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-debb165d-016a-449b-8963-775f2c88e0ff tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a1156cef-c5e5-45bf-852a-fb093cabde07 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:09 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a1156cef-c5e5-45bf-852a-fb093cabde07 Jul 10 00:46:09 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:09 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-09b3fb96-3d5b-4def-8eab-b1d6b5f84547 tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.714s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:09 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-09b3fb96-3d5b-4def-8eab-b1d6b5f84547 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:09 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-09b3fb96-3d5b-4def-8eab-b1d6b5f84547 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Deleted volume successfully. Jul 10 00:46:09 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9b8773b8-d0cd-40ca-8f14-9d3f6414e558" returned: 0 in 0.705s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:09 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:46:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.075s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:09 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-106851330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7beac152-3d81-4860-b506-5079dddc3230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a5739239c3442fb9a26935997ba85f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:03Z,use_quota=True,user_id='5b912297abfc4b1b92a605510c7f434f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:46:09 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Creating volume 7beac152-3d81-4860-b506-5079dddc3230 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:46:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:09 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:09 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:09 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:46:09 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:46:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7beac152-3d81-4860-b506-5079dddc3230 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:09 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7beac152-3d81-4860-b506-5079dddc3230 1073741824 Jul 10 00:46:09 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:09 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe747b0b-7897-4265-8a4e-9ad53c6608cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b8773b8-d0cd-40ca-8f14-9d3f6414e558', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:09 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2deee309-1f8a-4086-9c59-fde4ca7f934a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:09 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-09b3fb96-3d5b-4def-8eab-b1d6b5f84547 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-6b7ce41e-3aa7-412d-a6a7-65e1a2c412dc-delete_volume" released by "delete_volume" :: held 2.792s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:09 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Volume volume-9b8773b8-d0cd-40ca-8f14-9d3f6414e558 (9b8773b8-d0cd-40ca-8f14-9d3f6414e558): created successfully Jul 10 00:46:09 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2deee309-1f8a-4086-9c59-fde4ca7f934a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:09 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Flow 'volume_create_manager' (3389c2fe-4fe4-446e-ab61-6e24e00ee815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:09 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-efc33f66-3410-4698-862c-22ef0f229c8f tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Created volume successfully. Jul 10 00:46:10 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-debb165d-016a-449b-8963-775f2c88e0ff tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a1156cef-c5e5-45bf-852a-fb093cabde07" returned: 0 in 0.945s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-debb165d-016a-449b-8963-775f2c88e0ff tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a1156cef-c5e5-45bf-852a-fb093cabde07 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:10 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a1156cef-c5e5-45bf-852a-fb093cabde07 Jul 10 00:46:10 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:10 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7beac152-3d81-4860-b506-5079dddc3230 1073741824" returned: 0 in 0.912s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7beac152-3d81-4860-b506-5079dddc3230 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:10 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7beac152-3d81-4860-b506-5079dddc3230 Jul 10 00:46:10 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:11 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-debb165d-016a-449b-8963-775f2c88e0ff tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a1156cef-c5e5-45bf-852a-fb093cabde07" returned: 0 in 0.750s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-debb165d-016a-449b-8963-775f2c88e0ff tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-quobyte-a1156cef-c5e5-45bf-852a-fb093cabde07" released by "delete_volume" :: held 1.749s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-debb165d-016a-449b-8963-775f2c88e0ff tempest-CreateVolumesFromSnapshotTest-1043600788 None] Created reservations ['b4c3ae1d-e413-421b-88f8-589a4e7e16af', '5f4066ee-8b61-4e9b-bfdc-9bf44049666c', '1637e1a0-9833-4e3f-8090-7f122c2ce988', '434bdd42-2dd9-4bff-bb4b-0607d961c0e6'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-debb165d-016a-449b-8963-775f2c88e0ff tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-debb165d-016a-449b-8963-775f2c88e0ff tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-debb165d-016a-449b-8963-775f2c88e0ff tempest-CreateVolumesFromSnapshotTest-1043600788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-debb165d-016a-449b-8963-775f2c88e0ff tempest-CreateVolumesFromSnapshotTest-1043600788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-debb165d-016a-449b-8963-775f2c88e0ff tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-debb165d-016a-449b-8963-775f2c88e0ff tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:11 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:46:11 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:11 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7beac152-3d81-4860-b506-5079dddc3230" returned: 0 in 0.675s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.975s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b38c79b-69ba-4246-8e54-c09b6cac0820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a530ddf47a694c4a8975accdf45ea406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:07Z,use_quota=True,user_id='276c18320ad44716a6f4a93fb6ff2d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Creating volume 9b38c79b-69ba-4246-8e54-c09b6cac0820 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:46:11 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9b38c79b-69ba-4246-8e54-c09b6cac0820 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6e8658-0f5c-43e3-b1d7-6f1e2309c2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7beac152-3d81-4860-b506-5079dddc3230', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:11 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9b38c79b-69ba-4246-8e54-c09b6cac0820 1073741824 Jul 10 00:46:11 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d73bfa-8648-4cff-baae-901a5b2a40c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:11 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Volume volume-7beac152-3d81-4860-b506-5079dddc3230 (7beac152-3d81-4860-b506-5079dddc3230): created successfully Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4d73bfa-8648-4cff-baae-901a5b2a40c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Flow 'volume_create_manager' (75e38b07-1e36-4187-8030-c80af9fe3ce5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:11 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-df965651-df9d-4437-a534-68d9b9597e74 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Created volume successfully. Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-65b2939b-1859-48c6-b4a9-c12e05540414 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "cinder-00d670ac-d63f-480b-8654-3872bcef3af9-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-65b2939b-1859-48c6-b4a9-c12e05540414 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-00d670ac-d63f-480b-8654-3872bcef3af9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-65b2939b-1859-48c6-b4a9-c12e05540414 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "cinder-quobyte-bc7007d7-754e-43c0-83be-6553da2822a7" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-65b2939b-1859-48c6-b4a9-c12e05540414 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-quobyte-bc7007d7-754e-43c0-83be-6553da2822a7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-65b2939b-1859-48c6-b4a9-c12e05540414 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "cinder-quobyte-00d670ac-d63f-480b-8654-3872bcef3af9" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-65b2939b-1859-48c6-b4a9-c12e05540414 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-quobyte-00d670ac-d63f-480b-8654-3872bcef3af9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-65b2939b-1859-48c6-b4a9-c12e05540414 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Deleting offline snapshot 00d670ac-d63f-480b-8654-3872bcef3af9 of volume bc7007d7-754e-43c0-83be-6553da2822a7 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-65b2939b-1859-48c6-b4a9-c12e05540414 tempest-CreateVolumesFromSnapshotTest-1043600788 None] snapshot_file for this snap is: volume-bc7007d7-754e-43c0-83be-6553da2822a7.00d670ac-d63f-480b-8654-3872bcef3af9 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc67d95-aca2-48e5-bb04-600aaa9452b1]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-65b2939b-1859-48c6-b4a9-c12e05540414 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7.00d670ac-d63f-480b-8654-3872bcef3af9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:11 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7.00d670ac-d63f-480b-8654-3872bcef3af9 Jul 10 00:46:11 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:12 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-debb165d-016a-449b-8963-775f2c88e0ff tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.785s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:12 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-debb165d-016a-449b-8963-775f2c88e0ff tempest-CreateVolumesFromSnapshotTest-1043600788 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:12 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-debb165d-016a-449b-8963-775f2c88e0ff tempest-CreateVolumesFromSnapshotTest-1043600788 None] Deleted volume successfully. Jul 10 00:46:12 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-debb165d-016a-449b-8963-775f2c88e0ff tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-a1156cef-c5e5-45bf-852a-fb093cabde07-delete_volume" released by "delete_volume" :: held 2.804s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:12 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9b38c79b-69ba-4246-8e54-c09b6cac0820 1073741824" returned: 0 in 0.908s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9b38c79b-69ba-4246-8e54-c09b6cac0820 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:12 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9b38c79b-69ba-4246-8e54-c09b6cac0820 Jul 10 00:46:12 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:12 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-65b2939b-1859-48c6-b4a9-c12e05540414 tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7.00d670ac-d63f-480b-8654-3872bcef3af9" returned: 0 in 0.863s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:12 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-65b2939b-1859-48c6-b4a9-c12e05540414 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc7007d7-754e-43c0-83be-6553da2822a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:46:12 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace8c295-d566-4f5e-b2c9-8414c43b5b01]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-65b2939b-1859-48c6-b4a9-c12e05540414 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:12 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e3d34d47-04c3-4a99-9174-c63eaa522e20 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "cinder-7beac152-3d81-4860-b506-5079dddc3230-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:12 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7 Jul 10 00:46:12 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:12 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e3d34d47-04c3-4a99-9174-c63eaa522e20 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "cinder-7beac152-3d81-4860-b506-5079dddc3230-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:12 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e3d34d47-04c3-4a99-9174-c63eaa522e20 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "cinder-quobyte-7beac152-3d81-4860-b506-5079dddc3230" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:12 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e3d34d47-04c3-4a99-9174-c63eaa522e20 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "cinder-quobyte-7beac152-3d81-4860-b506-5079dddc3230" acquired by "delete_volume" :: waited 0.024s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:12 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb7b640-8673-4365-b2f6-b3605428eadf]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e3d34d47-04c3-4a99-9174-c63eaa522e20 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7beac152-3d81-4860-b506-5079dddc3230 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:12 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7beac152-3d81-4860-b506-5079dddc3230 Jul 10 00:46:12 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:13 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9b38c79b-69ba-4246-8e54-c09b6cac0820" returned: 0 in 0.753s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:46:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95240b0c-b472-478c-b311-7195ab4c1b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b38c79b-69ba-4246-8e54-c09b6cac0820', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb739b4-baac-4156-8125-a7eac77f55d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:13 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Volume volume-9b38c79b-69ba-4246-8e54-c09b6cac0820 (9b38c79b-69ba-4246-8e54-c09b6cac0820): created successfully Jul 10 00:46:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb739b4-baac-4156-8125-a7eac77f55d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Flow 'volume_create_manager' (e418b4f6-64f8-4b4e-a0b8-acb56402c818) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:13 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-ab54b767-57af-4e84-9960-21e50d4c8255 tempest-CinderUnicodeTest-492211907 None] Created volume successfully. Jul 10 00:46:13 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-65b2939b-1859-48c6-b4a9-c12e05540414 tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7" returned: 0 in 0.847s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-65b2939b-1859-48c6-b4a9-c12e05540414 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7.00d670ac-d63f-480b-8654-3872bcef3af9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:13 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7.00d670ac-d63f-480b-8654-3872bcef3af9 Jul 10 00:46:13 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:13 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e3d34d47-04c3-4a99-9174-c63eaa522e20 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7beac152-3d81-4860-b506-5079dddc3230" returned: 0 in 0.820s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e3d34d47-04c3-4a99-9174-c63eaa522e20 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7beac152-3d81-4860-b506-5079dddc3230 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:13 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7beac152-3d81-4860-b506-5079dddc3230 Jul 10 00:46:13 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Flow 'volume_create_manager' (8aa94635-af2a-42a9-9990-831b92e13629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39885f87-3270-4cd7-b5c8-1988766d41dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39885f87-3270-4cd7-b5c8-1988766d41dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-287497965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2819121-43a0-4618-be66-2df3c30c8e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a530ddf47a694c4a8975accdf45ea406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:14Z,use_quota=True,user_id='276c18320ad44716a6f4a93fb6ff2d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02063ce-1ac0-4ec3-9ede-e415604eefdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02063ce-1ac0-4ec3-9ede-e415604eefdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c475c826-fa60-42b7-85b1-f4bf6a0b36aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c475c826-fa60-42b7-85b1-f4bf6a0b36aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2819121-43a0-4618-be66-2df3c30c8e50', 'volume_name': 'volume-b2819121-43a0-4618-be66-2df3c30c8e50', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92f42d9f-546f-43d7-a8a5-69255b859c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92f42d9f-546f-43d7-a8a5-69255b859c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81636d4d-ed8a-4924-92cb-5f1f38abddb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:14 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Volume b2819121-43a0-4618-be66-2df3c30c8e50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2819121-43a0-4618-be66-2df3c30c8e50', 'volume_size': 1} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-287497965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2819121-43a0-4618-be66-2df3c30c8e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a530ddf47a694c4a8975accdf45ea406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:14Z,use_quota=True,user_id='276c18320ad44716a6f4a93fb6ff2d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Creating volume b2819121-43a0-4618-be66-2df3c30c8e50 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:46:14 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:14 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50 1073741824 Jul 10 00:46:14 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:14 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-65b2939b-1859-48c6-b4a9-c12e05540414 tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7.00d670ac-d63f-480b-8654-3872bcef3af9" returned: 0 in 0.886s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-65b2939b-1859-48c6-b4a9-c12e05540414 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7.00d670ac-d63f-480b-8654-3872bcef3af9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:14 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7.00d670ac-d63f-480b-8654-3872bcef3af9 Jul 10 00:46:14 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:14 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e3d34d47-04c3-4a99-9174-c63eaa522e20 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7beac152-3d81-4860-b506-5079dddc3230" returned: 0 in 0.729s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e3d34d47-04c3-4a99-9174-c63eaa522e20 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "cinder-quobyte-7beac152-3d81-4860-b506-5079dddc3230" released by "delete_volume" :: held 1.624s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-e3d34d47-04c3-4a99-9174-c63eaa522e20 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Created reservations ['11f98e54-a887-4c14-ab2c-9d842a48ea54', '00683614-8725-4b05-8f8f-afb177c9b21d', '4e0c970b-633c-4ca5-9e71-ee591315aa42', '49bb6a71-817e-4512-aee6-cd8ce4a11785'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e3d34d47-04c3-4a99-9174-c63eaa522e20 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e3d34d47-04c3-4a99-9174-c63eaa522e20 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e3d34d47-04c3-4a99-9174-c63eaa522e20 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e3d34d47-04c3-4a99-9174-c63eaa522e20 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e3d34d47-04c3-4a99-9174-c63eaa522e20 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e3d34d47-04c3-4a99-9174-c63eaa522e20 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:14 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:46:14 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:15 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-08080547-86ab-42e0-856e-f29adf8ba066 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "cinder-9b8773b8-d0cd-40ca-8f14-9d3f6414e558-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-65b2939b-1859-48c6-b4a9-c12e05540414 tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7.00d670ac-d63f-480b-8654-3872bcef3af9" returned: 0 in 0.789s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-08080547-86ab-42e0-856e-f29adf8ba066 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "cinder-9b8773b8-d0cd-40ca-8f14-9d3f6414e558-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-65b2939b-1859-48c6-b4a9-c12e05540414 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-quobyte-00d670ac-d63f-480b-8654-3872bcef3af9" released by "_delete_snapshot" :: held 3.574s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-65b2939b-1859-48c6-b4a9-c12e05540414 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-quobyte-bc7007d7-754e-43c0-83be-6553da2822a7" released by "delete_snapshot" :: held 3.613s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-08080547-86ab-42e0-856e-f29adf8ba066 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "cinder-quobyte-9b8773b8-d0cd-40ca-8f14-9d3f6414e558" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-08080547-86ab-42e0-856e-f29adf8ba066 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "cinder-quobyte-9b8773b8-d0cd-40ca-8f14-9d3f6414e558" acquired by "delete_volume" :: waited 0.032s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:15 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:15 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e372813-dc2e-4f83-8895-78e8575957c7]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08080547-86ab-42e0-856e-f29adf8ba066 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9b8773b8-d0cd-40ca-8f14-9d3f6414e558 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50 1073741824" returned: 0 in 1.124s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:15 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:15 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-65b2939b-1859-48c6-b4a9-c12e05540414 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Created reservations ['66a32238-d1d2-4fff-9597-4ddedc338e02', 'c8f1ba49-1db7-4fed-8538-c3b54f76921d', '2f28e5bb-28a9-488f-b329-306527e92e7e', '9c95aad1-8801-46ec-8560-98deccfc8df0'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e3d34d47-04c3-4a99-9174-c63eaa522e20 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.758s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:15 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-e3d34d47-04c3-4a99-9174-c63eaa522e20 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:15 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-e3d34d47-04c3-4a99-9174-c63eaa522e20 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Deleted volume successfully. Jul 10 00:46:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:15 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50 Jul 10 00:46:15 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e3d34d47-04c3-4a99-9174-c63eaa522e20 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "cinder-7beac152-3d81-4860-b506-5079dddc3230-delete_volume" released by "delete_volume" :: held 2.732s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:15 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9b8773b8-d0cd-40ca-8f14-9d3f6414e558 Jul 10 00:46:15 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:15 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-65b2939b-1859-48c6-b4a9-c12e05540414 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Delete snapshot completed successfully. Jul 10 00:46:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-65b2939b-1859-48c6-b4a9-c12e05540414 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-00d670ac-d63f-480b-8654-3872bcef3af9-delete_snapshot" released by "delete_snapshot" :: held 3.978s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-26728396-f2ce-4b83-a629-9af1049c78b2 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "cinder-bc7007d7-754e-43c0-83be-6553da2822a7-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:16 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-26728396-f2ce-4b83-a629-9af1049c78b2 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-bc7007d7-754e-43c0-83be-6553da2822a7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:16 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-26728396-f2ce-4b83-a629-9af1049c78b2 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "cinder-quobyte-bc7007d7-754e-43c0-83be-6553da2822a7" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:16 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-26728396-f2ce-4b83-a629-9af1049c78b2 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-quobyte-bc7007d7-754e-43c0-83be-6553da2822a7" acquired by "delete_volume" :: waited 0.025s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:16 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f4b210-0391-4168-8c3b-51206cf5dfe9]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-26728396-f2ce-4b83-a629-9af1049c78b2 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:16 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08080547-86ab-42e0-856e-f29adf8ba066 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9b8773b8-d0cd-40ca-8f14-9d3f6414e558" returned: 0 in 0.973s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08080547-86ab-42e0-856e-f29adf8ba066 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9b8773b8-d0cd-40ca-8f14-9d3f6414e558 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:16 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7 Jul 10 00:46:16 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:16 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9b8773b8-d0cd-40ca-8f14-9d3f6414e558 Jul 10 00:46:16 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:16 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50" returned: 0 in 0.958s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:16 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] <== create_volume: return (2164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:46:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.168s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81636d4d-ed8a-4924-92cb-5f1f38abddb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2819121-43a0-4618-be66-2df3c30c8e50', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c727f9a1-aa4b-42ed-802b-8c3a75214e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:16 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Volume volume-b2819121-43a0-4618-be66-2df3c30c8e50 (b2819121-43a0-4618-be66-2df3c30c8e50): created successfully Jul 10 00:46:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c727f9a1-aa4b-42ed-802b-8c3a75214e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Flow 'volume_create_manager' (8aa94635-af2a-42a9-9990-831b92e13629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:16 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-6ea3aed2-d5be-4a59-9882-d7748e333ad3 tempest-CinderUnicodeTest-492211907 None] Created volume successfully. Jul 10 00:46:17 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-26728396-f2ce-4b83-a629-9af1049c78b2 tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7" returned: 0 in 0.858s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-26728396-f2ce-4b83-a629-9af1049c78b2 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:17 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08080547-86ab-42e0-856e-f29adf8ba066 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9b8773b8-d0cd-40ca-8f14-9d3f6414e558" returned: 0 in 0.755s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:17 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7 Jul 10 00:46:17 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:17 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-08080547-86ab-42e0-856e-f29adf8ba066 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "cinder-quobyte-9b8773b8-d0cd-40ca-8f14-9d3f6414e558" released by "delete_volume" :: held 1.785s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:17 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-08080547-86ab-42e0-856e-f29adf8ba066 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Created reservations ['0f906a65-510e-4950-9432-68a9d9b51921', 'e2393ae2-59bb-4aa0-9997-0114787b1921', '046002a6-80c3-4e7b-882e-3ceb093ca71e', 'ed5ae327-0f5d-4d74-b547-afcafd370433'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-08080547-86ab-42e0-856e-f29adf8ba066 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-08080547-86ab-42e0-856e-f29adf8ba066 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-08080547-86ab-42e0-856e-f29adf8ba066 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-08080547-86ab-42e0-856e-f29adf8ba066 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-08080547-86ab-42e0-856e-f29adf8ba066 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08080547-86ab-42e0-856e-f29adf8ba066 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:17 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:46:17 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:17 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a28688e0-c0dd-485e-a162-926d7fb462be tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "cinder-7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:17 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a28688e0-c0dd-485e-a162-926d7fb462be tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "cinder-7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:17 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a28688e0-c0dd-485e-a162-926d7fb462be tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "cinder-quobyte-7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:17 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a28688e0-c0dd-485e-a162-926d7fb462be tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "cinder-quobyte-7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7" acquired by "delete_volume" :: waited 0.017s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:17 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[62842817-05a1-42df-bbc8-8e84b3ba64ae]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a28688e0-c0dd-485e-a162-926d7fb462be tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1619ae14-c23f-4bca-9802-a54e0a18555a tempest-CinderUnicodeTest-492211907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1619ae14-c23f-4bca-9802-a54e0a18555a tempest-CinderUnicodeTest-492211907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-1619ae14-c23f-4bca-9802-a54e0a18555a tempest-CinderUnicodeTest-492211907 None] Creating offline snapshot 39efa04e-32d1-4756-b4c7-9d9f224b74cb of volume b2819121-43a0-4618-be66-2df3c30c8e50 {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:46:17 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8622085d-1150-4821-88bb-3d6d21eaafc6]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1619ae14-c23f-4bca-9802-a54e0a18555a tempest-CinderUnicodeTest-492211907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:17 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7 Jul 10 00:46:17 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:17 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-26728396-f2ce-4b83-a629-9af1049c78b2 tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-bc7007d7-754e-43c0-83be-6553da2822a7" returned: 0 in 0.961s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:18 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50 Jul 10 00:46:18 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:18 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-26728396-f2ce-4b83-a629-9af1049c78b2 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-quobyte-bc7007d7-754e-43c0-83be-6553da2822a7" released by "delete_volume" :: held 1.897s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:18 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-26728396-f2ce-4b83-a629-9af1049c78b2 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Created reservations ['08f9d553-697c-4db2-98d8-580f35dbfe04', '41039d38-9a2d-42c7-8fd4-569cadd06cc1', '21f8e77f-049e-4782-894d-bb51ca7b1de2', 'f0594383-b0b1-464a-97c0-1e08540bf418'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-26728396-f2ce-4b83-a629-9af1049c78b2 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-26728396-f2ce-4b83-a629-9af1049c78b2 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:18 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-26728396-f2ce-4b83-a629-9af1049c78b2 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:18 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-26728396-f2ce-4b83-a629-9af1049c78b2 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-26728396-f2ce-4b83-a629-9af1049c78b2 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-26728396-f2ce-4b83-a629-9af1049c78b2 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:18 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:46:18 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:18 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08080547-86ab-42e0-856e-f29adf8ba066 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.068s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:18 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-08080547-86ab-42e0-856e-f29adf8ba066 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:18 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-08080547-86ab-42e0-856e-f29adf8ba066 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Deleted volume successfully. Jul 10 00:46:18 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-08080547-86ab-42e0-856e-f29adf8ba066 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "cinder-9b8773b8-d0cd-40ca-8f14-9d3f6414e558-delete_volume" released by "delete_volume" :: held 3.250s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:18 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1619ae14-c23f-4bca-9802-a54e0a18555a tempest-CinderUnicodeTest-492211907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50" returned: 0 in 1.002s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1619ae14-c23f-4bca-9802-a54e0a18555a tempest-CinderUnicodeTest-492211907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50.39efa04e-32d1-4756-b4c7-9d9f224b74cb 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:18 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50.39efa04e-32d1-4756-b4c7-9d9f224b74cb 1G Jul 10 00:46:18 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:18 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a28688e0-c0dd-485e-a162-926d7fb462be tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7" returned: 0 in 1.183s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a28688e0-c0dd-485e-a162-926d7fb462be tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:18 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7 Jul 10 00:46:18 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:19 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-26728396-f2ce-4b83-a629-9af1049c78b2 tempest-CreateVolumesFromSnapshotTest-1043600788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.172s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:19 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-26728396-f2ce-4b83-a629-9af1049c78b2 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:19 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-26728396-f2ce-4b83-a629-9af1049c78b2 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Deleted volume successfully. Jul 10 00:46:19 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=133,cinder:UPDATE=199,cinder:DELETE=22,cinder:INSERT=47 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:46:19 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-26728396-f2ce-4b83-a629-9af1049c78b2 tempest-CreateVolumesFromSnapshotTest-1043600788 None] Lock "cinder-bc7007d7-754e-43c0-83be-6553da2822a7-delete_volume" released by "delete_volume" :: held 3.459s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:19 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1619ae14-c23f-4bca-9802-a54e0a18555a tempest-CinderUnicodeTest-492211907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50.39efa04e-32d1-4756-b4c7-9d9f224b74cb 1G" returned: 0 in 1.016s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1619ae14-c23f-4bca-9802-a54e0a18555a tempest-CinderUnicodeTest-492211907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2819121-43a0-4618-be66-2df3c30c8e50 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50.39efa04e-32d1-4756-b4c7-9d9f224b74cb {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:19 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2819121-43a0-4618-be66-2df3c30c8e50 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50.39efa04e-32d1-4756-b4c7-9d9f224b74cb Jul 10 00:46:19 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:19 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a28688e0-c0dd-485e-a162-926d7fb462be tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7" returned: 0 in 1.042s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:19 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a28688e0-c0dd-485e-a162-926d7fb462be tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "cinder-quobyte-7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7" released by "delete_volume" :: held 2.296s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:19 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-a28688e0-c0dd-485e-a162-926d7fb462be tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Created reservations ['c3038f29-ad79-4085-9390-7a755173ff03', 'f065ee95-2bb7-4ee4-b4a2-c4dba6ee43da', 'bd23edf5-d721-4476-839a-6adee7a4c1b4', 'ff570afe-4e9a-4fe0-b32b-f4569d68a3fe'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a28688e0-c0dd-485e-a162-926d7fb462be tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a28688e0-c0dd-485e-a162-926d7fb462be tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:20 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a28688e0-c0dd-485e-a162-926d7fb462be tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:20 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a28688e0-c0dd-485e-a162-926d7fb462be tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a28688e0-c0dd-485e-a162-926d7fb462be tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a28688e0-c0dd-485e-a162-926d7fb462be tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:20 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:46:20 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:20 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1619ae14-c23f-4bca-9802-a54e0a18555a tempest-CinderUnicodeTest-492211907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2819121-43a0-4618-be66-2df3c30c8e50 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50.39efa04e-32d1-4756-b4c7-9d9f224b74cb" returned: 0 in 0.837s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:20 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-1619ae14-c23f-4bca-9802-a54e0a18555a tempest-CinderUnicodeTest-492211907 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50.39efa04e-32d1-4756-b4c7-9d9f224b74cb is being set with open permissions: ugo+rw Jul 10 00:46:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1619ae14-c23f-4bca-9802-a54e0a18555a tempest-CinderUnicodeTest-492211907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50.39efa04e-32d1-4756-b4c7-9d9f224b74cb {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:20 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50.39efa04e-32d1-4756-b4c7-9d9f224b74cb Jul 10 00:46:20 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:20 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a28688e0-c0dd-485e-a162-926d7fb462be tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.753s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:20 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-a28688e0-c0dd-485e-a162-926d7fb462be tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:20 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-a28688e0-c0dd-485e-a162-926d7fb462be tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Deleted volume successfully. Jul 10 00:46:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a28688e0-c0dd-485e-a162-926d7fb462be tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "cinder-7c1fca03-7fc6-4bee-a7b0-d9d8286d9eb7-delete_volume" released by "delete_volume" :: held 3.311s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:21 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c8c91ddb-2d29-4ee7-8f57-05e4f6ef3c4d tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "cinder-d468eb6e-7b0b-4f8e-8e5f-1132f491838b-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:21 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c8c91ddb-2d29-4ee7-8f57-05e4f6ef3c4d tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "cinder-d468eb6e-7b0b-4f8e-8e5f-1132f491838b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:21 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c8c91ddb-2d29-4ee7-8f57-05e4f6ef3c4d tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "cinder-quobyte-d468eb6e-7b0b-4f8e-8e5f-1132f491838b" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:21 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c8c91ddb-2d29-4ee7-8f57-05e4f6ef3c4d tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "cinder-quobyte-d468eb6e-7b0b-4f8e-8e5f-1132f491838b" acquired by "delete_volume" :: waited 0.032s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:21 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bd7341-8a7a-4b72-ad95-ad7b9fd2bd72]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c8c91ddb-2d29-4ee7-8f57-05e4f6ef3c4d tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d468eb6e-7b0b-4f8e-8e5f-1132f491838b {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:21 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d468eb6e-7b0b-4f8e-8e5f-1132f491838b Jul 10 00:46:21 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:21 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1619ae14-c23f-4bca-9802-a54e0a18555a tempest-CinderUnicodeTest-492211907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50.39efa04e-32d1-4756-b4c7-9d9f224b74cb" returned: 0 in 0.970s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1619ae14-c23f-4bca-9802-a54e0a18555a tempest-CinderUnicodeTest-492211907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:21 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50.info Jul 10 00:46:21 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:22 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c8c91ddb-2d29-4ee7-8f57-05e4f6ef3c4d tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d468eb6e-7b0b-4f8e-8e5f-1132f491838b" returned: 0 in 0.875s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c8c91ddb-2d29-4ee7-8f57-05e4f6ef3c4d tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d468eb6e-7b0b-4f8e-8e5f-1132f491838b {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:22 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d468eb6e-7b0b-4f8e-8e5f-1132f491838b Jul 10 00:46:22 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:22 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1619ae14-c23f-4bca-9802-a54e0a18555a tempest-CinderUnicodeTest-492211907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50.info" returned: 0 in 0.673s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:22 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-1619ae14-c23f-4bca-9802-a54e0a18555a tempest-CinderUnicodeTest-492211907 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50.info is being set with open permissions: ugo+rw Jul 10 00:46:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1619ae14-c23f-4bca-9802-a54e0a18555a tempest-CinderUnicodeTest-492211907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:22 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50.info Jul 10 00:46:22 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:22 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c8c91ddb-2d29-4ee7-8f57-05e4f6ef3c4d tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-d468eb6e-7b0b-4f8e-8e5f-1132f491838b" returned: 0 in 0.741s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:22 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c8c91ddb-2d29-4ee7-8f57-05e4f6ef3c4d tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "cinder-quobyte-d468eb6e-7b0b-4f8e-8e5f-1132f491838b" released by "delete_volume" :: held 1.673s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:22 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-c8c91ddb-2d29-4ee7-8f57-05e4f6ef3c4d tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Created reservations ['87886bb5-8a29-49e6-bff2-db05a4848d1f', '93d36661-6840-4e1f-b621-0c5449d1b27c', '18a1fd50-eb4c-41ee-bdcd-d04710eb3482', 'f690f298-f817-4ebc-aada-67aee79fc3f3'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c8c91ddb-2d29-4ee7-8f57-05e4f6ef3c4d tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c8c91ddb-2d29-4ee7-8f57-05e4f6ef3c4d tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:22 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c8c91ddb-2d29-4ee7-8f57-05e4f6ef3c4d tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:22 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c8c91ddb-2d29-4ee7-8f57-05e4f6ef3c4d tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c8c91ddb-2d29-4ee7-8f57-05e4f6ef3c4d tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c8c91ddb-2d29-4ee7-8f57-05e4f6ef3c4d tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:22 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:46:22 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:23 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-5ac44b10-75fa-41f8-82ab-318e4e3c98cf tempest-ProjectAdminTests-517768845 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577667236328, 'free_capacity_gb': 1775.7577667236328, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88119) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4831}} Jul 10 00:46:23 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1619ae14-c23f-4bca-9802-a54e0a18555a tempest-CinderUnicodeTest-492211907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50.info" returned: 0 in 0.741s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1619ae14-c23f-4bca-9802-a54e0a18555a tempest-CinderUnicodeTest-492211907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.378s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:23 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-1619ae14-c23f-4bca-9802-a54e0a18555a tempest-CinderUnicodeTest-492211907 None] Create snapshot completed successfully Jul 10 00:46:23 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8c601284-166e-4cba-b655-1b37d3c9097c tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "cinder-b0035d14-32d2-415e-898f-54c5ecfcc09d-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:23 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8c601284-166e-4cba-b655-1b37d3c9097c tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "cinder-b0035d14-32d2-415e-898f-54c5ecfcc09d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:23 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8c601284-166e-4cba-b655-1b37d3c9097c tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "cinder-quobyte-b0035d14-32d2-415e-898f-54c5ecfcc09d" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:23 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8c601284-166e-4cba-b655-1b37d3c9097c tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "cinder-quobyte-b0035d14-32d2-415e-898f-54c5ecfcc09d" acquired by "delete_volume" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:23 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e888a9e5-2d0f-4b5a-a8a2-d818301ac11f]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8c601284-166e-4cba-b655-1b37d3c9097c tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0035d14-32d2-415e-898f-54c5ecfcc09d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:23 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0035d14-32d2-415e-898f-54c5ecfcc09d Jul 10 00:46:23 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:23 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c8c91ddb-2d29-4ee7-8f57-05e4f6ef3c4d tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.795s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:23 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-c8c91ddb-2d29-4ee7-8f57-05e4f6ef3c4d tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:23 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-c8c91ddb-2d29-4ee7-8f57-05e4f6ef3c4d tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Deleted volume successfully. Jul 10 00:46:23 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c8c91ddb-2d29-4ee7-8f57-05e4f6ef3c4d tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "cinder-d468eb6e-7b0b-4f8e-8e5f-1132f491838b-delete_volume" released by "delete_volume" :: held 2.731s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c6956ec2-79c7-4846-9d6c-05bd08852c2a tempest-CinderUnicodeTest-492211907 None] Acquiring lock "cinder-39efa04e-32d1-4756-b4c7-9d9f224b74cb-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c6956ec2-79c7-4846-9d6c-05bd08852c2a tempest-CinderUnicodeTest-492211907 None] Lock "cinder-39efa04e-32d1-4756-b4c7-9d9f224b74cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c6956ec2-79c7-4846-9d6c-05bd08852c2a tempest-CinderUnicodeTest-492211907 None] Acquiring lock "cinder-quobyte-b2819121-43a0-4618-be66-2df3c30c8e50" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:24 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8c601284-166e-4cba-b655-1b37d3c9097c tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0035d14-32d2-415e-898f-54c5ecfcc09d" returned: 0 in 0.932s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8c601284-166e-4cba-b655-1b37d3c9097c tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0035d14-32d2-415e-898f-54c5ecfcc09d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c6956ec2-79c7-4846-9d6c-05bd08852c2a tempest-CinderUnicodeTest-492211907 None] Lock "cinder-quobyte-b2819121-43a0-4618-be66-2df3c30c8e50" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c6956ec2-79c7-4846-9d6c-05bd08852c2a tempest-CinderUnicodeTest-492211907 None] Acquiring lock "cinder-quobyte-39efa04e-32d1-4756-b4c7-9d9f224b74cb" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:24 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0035d14-32d2-415e-898f-54c5ecfcc09d Jul 10 00:46:24 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:24 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c6956ec2-79c7-4846-9d6c-05bd08852c2a tempest-CinderUnicodeTest-492211907 None] Lock "cinder-quobyte-39efa04e-32d1-4756-b4c7-9d9f224b74cb" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-c6956ec2-79c7-4846-9d6c-05bd08852c2a tempest-CinderUnicodeTest-492211907 None] Deleting offline snapshot 39efa04e-32d1-4756-b4c7-9d9f224b74cb of volume b2819121-43a0-4618-be66-2df3c30c8e50 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:46:24 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-c6956ec2-79c7-4846-9d6c-05bd08852c2a tempest-CinderUnicodeTest-492211907 None] snapshot_file for this snap is: volume-b2819121-43a0-4618-be66-2df3c30c8e50.39efa04e-32d1-4756-b4c7-9d9f224b74cb {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:46:24 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f799fae-6106-47df-adb5-4e52178895f6]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c6956ec2-79c7-4846-9d6c-05bd08852c2a tempest-CinderUnicodeTest-492211907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50.39efa04e-32d1-4756-b4c7-9d9f224b74cb {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:24 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50.39efa04e-32d1-4756-b4c7-9d9f224b74cb Jul 10 00:46:24 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:25 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8c601284-166e-4cba-b655-1b37d3c9097c tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0035d14-32d2-415e-898f-54c5ecfcc09d" returned: 0 in 0.806s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:25 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8c601284-166e-4cba-b655-1b37d3c9097c tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "cinder-quobyte-b0035d14-32d2-415e-898f-54c5ecfcc09d" released by "delete_volume" :: held 1.791s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:25 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-8c601284-166e-4cba-b655-1b37d3c9097c tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Created reservations ['f4e5cfda-da3e-41d2-84da-46f1ea742eb0', 'cd193de8-e264-4380-b8f7-41b984ae245f', '8f7b84ea-f21d-4dca-9936-6d40bc3fa28d', 'e23408bd-f123-4a48-892f-44a9dc620477'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8c601284-166e-4cba-b655-1b37d3c9097c tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8c601284-166e-4cba-b655-1b37d3c9097c tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:25 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8c601284-166e-4cba-b655-1b37d3c9097c tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:25 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-8c601284-166e-4cba-b655-1b37d3c9097c tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8c601284-166e-4cba-b655-1b37d3c9097c tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8c601284-166e-4cba-b655-1b37d3c9097c tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:25 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:46:25 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:25 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c6956ec2-79c7-4846-9d6c-05bd08852c2a tempest-CinderUnicodeTest-492211907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50.39efa04e-32d1-4756-b4c7-9d9f224b74cb" returned: 0 in 0.982s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:25 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-c6956ec2-79c7-4846-9d6c-05bd08852c2a tempest-CinderUnicodeTest-492211907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2819121-43a0-4618-be66-2df3c30c8e50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:46:25 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5203bf6-cf9a-4b71-a6aa-c790af04dfdc]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c6956ec2-79c7-4846-9d6c-05bd08852c2a tempest-CinderUnicodeTest-492211907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:25 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50 Jul 10 00:46:25 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:25 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c74d2ded-af4e-4450-aed5-4a3ec45230a4 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "cinder-a96dd062-bbbf-4be7-9ed5-a9d63f3c932f-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:25 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c74d2ded-af4e-4450-aed5-4a3ec45230a4 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "cinder-a96dd062-bbbf-4be7-9ed5-a9d63f3c932f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:25 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c74d2ded-af4e-4450-aed5-4a3ec45230a4 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "cinder-quobyte-a96dd062-bbbf-4be7-9ed5-a9d63f3c932f" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:25 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c74d2ded-af4e-4450-aed5-4a3ec45230a4 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "cinder-quobyte-a96dd062-bbbf-4be7-9ed5-a9d63f3c932f" acquired by "delete_volume" :: waited 0.032s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:25 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcd1e9f-ada2-4246-b132-8638a7856e3a]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c74d2ded-af4e-4450-aed5-4a3ec45230a4 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a96dd062-bbbf-4be7-9ed5-a9d63f3c932f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:26 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a96dd062-bbbf-4be7-9ed5-a9d63f3c932f Jul 10 00:46:26 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:26 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8c601284-166e-4cba-b655-1b37d3c9097c tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.006s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:26 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-8c601284-166e-4cba-b655-1b37d3c9097c tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:26 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-8c601284-166e-4cba-b655-1b37d3c9097c tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Deleted volume successfully. Jul 10 00:46:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8c601284-166e-4cba-b655-1b37d3c9097c tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "cinder-b0035d14-32d2-415e-898f-54c5ecfcc09d-delete_volume" released by "delete_volume" :: held 3.099s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:26 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c6956ec2-79c7-4846-9d6c-05bd08852c2a tempest-CinderUnicodeTest-492211907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50" returned: 0 in 1.148s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c6956ec2-79c7-4846-9d6c-05bd08852c2a tempest-CinderUnicodeTest-492211907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50.39efa04e-32d1-4756-b4c7-9d9f224b74cb {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:26 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50.39efa04e-32d1-4756-b4c7-9d9f224b74cb Jul 10 00:46:26 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:27 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c74d2ded-af4e-4450-aed5-4a3ec45230a4 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a96dd062-bbbf-4be7-9ed5-a9d63f3c932f" returned: 0 in 1.124s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c74d2ded-af4e-4450-aed5-4a3ec45230a4 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a96dd062-bbbf-4be7-9ed5-a9d63f3c932f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:27 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a96dd062-bbbf-4be7-9ed5-a9d63f3c932f Jul 10 00:46:27 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:27 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c6956ec2-79c7-4846-9d6c-05bd08852c2a tempest-CinderUnicodeTest-492211907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50.39efa04e-32d1-4756-b4c7-9d9f224b74cb" returned: 0 in 0.894s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c6956ec2-79c7-4846-9d6c-05bd08852c2a tempest-CinderUnicodeTest-492211907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50.39efa04e-32d1-4756-b4c7-9d9f224b74cb {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:27 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50.39efa04e-32d1-4756-b4c7-9d9f224b74cb Jul 10 00:46:27 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:27 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c74d2ded-af4e-4450-aed5-4a3ec45230a4 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-a96dd062-bbbf-4be7-9ed5-a9d63f3c932f" returned: 0 in 0.830s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:27 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c74d2ded-af4e-4450-aed5-4a3ec45230a4 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "cinder-quobyte-a96dd062-bbbf-4be7-9ed5-a9d63f3c932f" released by "delete_volume" :: held 2.032s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:27 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=170,cinder:UPDATE=215,cinder:INSERT=63,cinder:DELETE=18 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-c74d2ded-af4e-4450-aed5-4a3ec45230a4 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Created reservations ['267776fe-2bd9-4c92-9a49-8408b7ae8854', '919fdedf-302f-4504-9ba4-d53d05c5b177', '08405db5-acf5-4fd5-8d9c-6c55d127dec3', 'c3d3b2da-1511-48f2-80f7-b8662ab91e34'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c74d2ded-af4e-4450-aed5-4a3ec45230a4 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c74d2ded-af4e-4450-aed5-4a3ec45230a4 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c74d2ded-af4e-4450-aed5-4a3ec45230a4 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c74d2ded-af4e-4450-aed5-4a3ec45230a4 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c74d2ded-af4e-4450-aed5-4a3ec45230a4 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c74d2ded-af4e-4450-aed5-4a3ec45230a4 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:28 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:46:28 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:28 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c6956ec2-79c7-4846-9d6c-05bd08852c2a tempest-CinderUnicodeTest-492211907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50.39efa04e-32d1-4756-b4c7-9d9f224b74cb" returned: 0 in 0.947s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Flow 'volume_create_manager' (e5981c00-3680-4019-8d0e-ef193628bcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe8bb83-dc72-48a2-9973-4cb94b021efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c6956ec2-79c7-4846-9d6c-05bd08852c2a tempest-CinderUnicodeTest-492211907 None] Lock "cinder-quobyte-39efa04e-32d1-4756-b4c7-9d9f224b74cb" released by "_delete_snapshot" :: held 4.202s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c6956ec2-79c7-4846-9d6c-05bd08852c2a tempest-CinderUnicodeTest-492211907 None] Lock "cinder-quobyte-b2819121-43a0-4618-be66-2df3c30c8e50" released by "delete_snapshot" :: held 4.242s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe8bb83-dc72-48a2-9973-4cb94b021efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-155951268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805ceb41-17d2-409c-ba49-a529f78b93c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ddba97f683451bb34de66617558765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:28Z,use_quota=True,user_id='63ae47eec5994dd3b7598e353d8dd777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc5d122d-cccf-4cb3-8ef3-e0b6af93779e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc5d122d-cccf-4cb3-8ef3-e0b6af93779e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b5f79e-607a-47b8-a146-775eaf8ad049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b5f79e-607a-47b8-a146-775eaf8ad049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '805ceb41-17d2-409c-ba49-a529f78b93c1', 'volume_name': 'volume-805ceb41-17d2-409c-ba49-a529f78b93c1', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f5178e3-d9a3-4dac-b6d2-aaea59eef808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f5178e3-d9a3-4dac-b6d2-aaea59eef808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88115785-431b-4633-a2b7-b11020a5d6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:28 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Volume 805ceb41-17d2-409c-ba49-a529f78b93c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-805ceb41-17d2-409c-ba49-a529f78b93c1', 'volume_size': 1} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-155951268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805ceb41-17d2-409c-ba49-a529f78b93c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ddba97f683451bb34de66617558765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:28Z,use_quota=True,user_id='63ae47eec5994dd3b7598e353d8dd777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Creating volume 805ceb41-17d2-409c-ba49-a529f78b93c1 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:46:28 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-805ceb41-17d2-409c-ba49-a529f78b93c1 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:28 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-805ceb41-17d2-409c-ba49-a529f78b93c1 1073741824 Jul 10 00:46:28 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-c6956ec2-79c7-4846-9d6c-05bd08852c2a tempest-CinderUnicodeTest-492211907 None] Created reservations ['ae0645ef-ddbf-4f5c-998b-097dab480f1b', 'fac8f05f-2bb3-4d94-b328-e630ad81ec2e', 'd16b964e-1a6f-484b-b691-e57518740c65', 'afa2b759-c557-4700-9b0e-ea7886489583'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:28 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-c6956ec2-79c7-4846-9d6c-05bd08852c2a tempest-CinderUnicodeTest-492211907 None] Delete snapshot completed successfully. Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c6956ec2-79c7-4846-9d6c-05bd08852c2a tempest-CinderUnicodeTest-492211907 None] Lock "cinder-39efa04e-32d1-4756-b4c7-9d9f224b74cb-delete_snapshot" released by "delete_snapshot" :: held 4.504s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:28 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c74d2ded-af4e-4450-aed5-4a3ec45230a4 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.740s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-c74d2ded-af4e-4450-aed5-4a3ec45230a4 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:28 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-c74d2ded-af4e-4450-aed5-4a3ec45230a4 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Deleted volume successfully. Jul 10 00:46:28 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c74d2ded-af4e-4450-aed5-4a3ec45230a4 tempest-CreateVolumesFromSourceVolumeTest-1067520131 None] Lock "cinder-a96dd062-bbbf-4be7-9ed5-a9d63f3c932f-delete_volume" released by "delete_volume" :: held 3.123s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:29 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-805ceb41-17d2-409c-ba49-a529f78b93c1 1073741824" returned: 0 in 1.012s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:29 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7e0737b2-e04b-4bcb-aa91-308b319ec387 tempest-CinderUnicodeTest-492211907 None] Acquiring lock "cinder-b2819121-43a0-4618-be66-2df3c30c8e50-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:29 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7e0737b2-e04b-4bcb-aa91-308b319ec387 tempest-CinderUnicodeTest-492211907 None] Lock "cinder-b2819121-43a0-4618-be66-2df3c30c8e50-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-805ceb41-17d2-409c-ba49-a529f78b93c1 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:29 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-805ceb41-17d2-409c-ba49-a529f78b93c1 Jul 10 00:46:29 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:29 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7e0737b2-e04b-4bcb-aa91-308b319ec387 tempest-CinderUnicodeTest-492211907 None] Acquiring lock "cinder-quobyte-b2819121-43a0-4618-be66-2df3c30c8e50" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:29 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7e0737b2-e04b-4bcb-aa91-308b319ec387 tempest-CinderUnicodeTest-492211907 None] Lock "cinder-quobyte-b2819121-43a0-4618-be66-2df3c30c8e50" acquired by "delete_volume" :: waited 0.024s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:29 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4273e1-302c-4b67-a1cd-4a72be3399e8]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7e0737b2-e04b-4bcb-aa91-308b319ec387 tempest-CinderUnicodeTest-492211907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:30 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50 Jul 10 00:46:30 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:30 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-805ceb41-17d2-409c-ba49-a529f78b93c1" returned: 0 in 0.843s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:30 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:46:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88115785-431b-4633-a2b7-b11020a5d6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-805ceb41-17d2-409c-ba49-a529f78b93c1', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (decf25af-1378-4058-b4d4-c3b65d54eae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:30 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Volume volume-805ceb41-17d2-409c-ba49-a529f78b93c1 (805ceb41-17d2-409c-ba49-a529f78b93c1): created successfully Jul 10 00:46:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (decf25af-1378-4058-b4d4-c3b65d54eae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Flow 'volume_create_manager' (e5981c00-3680-4019-8d0e-ef193628bcf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:30 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-02f20a48-1d39-42ed-ba2b-3d3fc974999e tempest-ProjectReaderTests-1052592944 None] Created volume successfully. Jul 10 00:46:30 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7e0737b2-e04b-4bcb-aa91-308b319ec387 tempest-CinderUnicodeTest-492211907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50" returned: 0 in 0.923s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7e0737b2-e04b-4bcb-aa91-308b319ec387 tempest-CinderUnicodeTest-492211907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:30 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50 Jul 10 00:46:30 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:31 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7e0737b2-e04b-4bcb-aa91-308b319ec387 tempest-CinderUnicodeTest-492211907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b2819121-43a0-4618-be66-2df3c30c8e50" returned: 0 in 0.698s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:31 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7e0737b2-e04b-4bcb-aa91-308b319ec387 tempest-CinderUnicodeTest-492211907 None] Lock "cinder-quobyte-b2819121-43a0-4618-be66-2df3c30c8e50" released by "delete_volume" :: held 1.721s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:31 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-7e0737b2-e04b-4bcb-aa91-308b319ec387 tempest-CinderUnicodeTest-492211907 None] Created reservations ['7bb549de-81d0-4b43-a5ad-5b1671cbb1fc', 'b909d7b8-f6fb-4e70-81ec-04869356d438', '3665be10-5450-495e-a973-fca81d11eaa6', 'f3895865-178c-4b5b-91d1-b6c1479ffce8'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:46:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:31 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:46:31 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7e0737b2-e04b-4bcb-aa91-308b319ec387 tempest-CinderUnicodeTest-492211907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7e0737b2-e04b-4bcb-aa91-308b319ec387 tempest-CinderUnicodeTest-492211907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7e0737b2-e04b-4bcb-aa91-308b319ec387 tempest-CinderUnicodeTest-492211907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7e0737b2-e04b-4bcb-aa91-308b319ec387 tempest-CinderUnicodeTest-492211907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7e0737b2-e04b-4bcb-aa91-308b319ec387 tempest-CinderUnicodeTest-492211907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7e0737b2-e04b-4bcb-aa91-308b319ec387 tempest-CinderUnicodeTest-492211907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:31 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:46:31 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bdd406cf-06a4-49a0-adfe-b6923e90f913 tempest-CinderUnicodeTest-492211907 None] Acquiring lock "cinder-9b38c79b-69ba-4246-8e54-c09b6cac0820-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bdd406cf-06a4-49a0-adfe-b6923e90f913 tempest-CinderUnicodeTest-492211907 None] Lock "cinder-9b38c79b-69ba-4246-8e54-c09b6cac0820-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bdd406cf-06a4-49a0-adfe-b6923e90f913 tempest-CinderUnicodeTest-492211907 None] Acquiring lock "cinder-quobyte-9b38c79b-69ba-4246-8e54-c09b6cac0820" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bdd406cf-06a4-49a0-adfe-b6923e90f913 tempest-CinderUnicodeTest-492211907 None] Lock "cinder-quobyte-9b38c79b-69ba-4246-8e54-c09b6cac0820" acquired by "delete_volume" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:32 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea8f01e-427c-46e4-a724-b43c0050958a]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bdd406cf-06a4-49a0-adfe-b6923e90f913 tempest-CinderUnicodeTest-492211907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9b38c79b-69ba-4246-8e54-c09b6cac0820 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-99beccf3-63f7-40dd-a2c7-b351e525efd3 tempest-ProjectReaderTests-1052592944 None] Acquiring lock "cinder-805ceb41-17d2-409c-ba49-a529f78b93c1-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-99beccf3-63f7-40dd-a2c7-b351e525efd3 tempest-ProjectReaderTests-1052592944 None] Lock "cinder-805ceb41-17d2-409c-ba49-a529f78b93c1-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-99beccf3-63f7-40dd-a2c7-b351e525efd3 tempest-ProjectReaderTests-1052592944 None] Acquiring lock "cinder-quobyte-805ceb41-17d2-409c-ba49-a529f78b93c1" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-99beccf3-63f7-40dd-a2c7-b351e525efd3 tempest-ProjectReaderTests-1052592944 None] Lock "cinder-quobyte-805ceb41-17d2-409c-ba49-a529f78b93c1" acquired by "delete_volume" :: waited 0.036s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:32 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9b38c79b-69ba-4246-8e54-c09b6cac0820 Jul 10 00:46:32 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:32 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[69622053-0691-44e3-bed8-1877fda7c255]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-99beccf3-63f7-40dd-a2c7-b351e525efd3 tempest-ProjectReaderTests-1052592944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-805ceb41-17d2-409c-ba49-a529f78b93c1 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:32 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.979s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:32 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:32 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:46:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 29 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:46:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:46:32 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-805ceb41-17d2-409c-ba49-a529f78b93c1 Jul 10 00:46:32 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:33 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7e0737b2-e04b-4bcb-aa91-308b319ec387 tempest-CinderUnicodeTest-492211907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.359s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-7e0737b2-e04b-4bcb-aa91-308b319ec387 tempest-CinderUnicodeTest-492211907 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:33 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-7e0737b2-e04b-4bcb-aa91-308b319ec387 tempest-CinderUnicodeTest-492211907 None] Deleted volume successfully. Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7e0737b2-e04b-4bcb-aa91-308b319ec387 tempest-CinderUnicodeTest-492211907 None] Lock "cinder-b2819121-43a0-4618-be66-2df3c30c8e50-delete_volume" released by "delete_volume" :: held 3.391s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Flow 'volume_create_manager' (c5607e75-0274-41ac-8713-3a6267c42d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c16d4ea-e292-4a3e-8d09-55c036f04d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c16d4ea-e292-4a3e-8d09-55c036f04d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2090686171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db11a356-aec3-49b8-92f6-7241e7a614de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6c136f59b34f3385d38a9e5fc5aeef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:33Z,use_quota=True,user_id='b00028b9100748dcad43994aa4e7518a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4026304-efb3-42fa-8723-e3b77cd7d1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4026304-efb3-42fa-8723-e3b77cd7d1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea309fc6-d1f6-426a-b245-f742cfadf17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea309fc6-d1f6-426a-b245-f742cfadf17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db11a356-aec3-49b8-92f6-7241e7a614de', 'volume_name': 'volume-db11a356-aec3-49b8-92f6-7241e7a614de', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33508a61-c917-4742-889d-4dab0da564ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33508a61-c917-4742-889d-4dab0da564ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd05d390-4fe1-42f3-b745-f0aed5f58c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:33 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Volume db11a356-aec3-49b8-92f6-7241e7a614de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db11a356-aec3-49b8-92f6-7241e7a614de', 'volume_size': 1} Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2090686171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db11a356-aec3-49b8-92f6-7241e7a614de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6c136f59b34f3385d38a9e5fc5aeef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:33Z,use_quota=True,user_id='b00028b9100748dcad43994aa4e7518a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Creating volume db11a356-aec3-49b8-92f6-7241e7a614de {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:46:33 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:33 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de 1073741824 Jul 10 00:46:33 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:33 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bdd406cf-06a4-49a0-adfe-b6923e90f913 tempest-CinderUnicodeTest-492211907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9b38c79b-69ba-4246-8e54-c09b6cac0820" returned: 0 in 1.243s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bdd406cf-06a4-49a0-adfe-b6923e90f913 tempest-CinderUnicodeTest-492211907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9b38c79b-69ba-4246-8e54-c09b6cac0820 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:33 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9b38c79b-69ba-4246-8e54-c09b6cac0820 Jul 10 00:46:33 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:33 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-99beccf3-63f7-40dd-a2c7-b351e525efd3 tempest-ProjectReaderTests-1052592944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-805ceb41-17d2-409c-ba49-a529f78b93c1" returned: 0 in 1.096s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-99beccf3-63f7-40dd-a2c7-b351e525efd3 tempest-ProjectReaderTests-1052592944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-805ceb41-17d2-409c-ba49-a529f78b93c1 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:33 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-805ceb41-17d2-409c-ba49-a529f78b93c1 Jul 10 00:46:33 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:34 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bdd406cf-06a4-49a0-adfe-b6923e90f913 tempest-CinderUnicodeTest-492211907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-9b38c79b-69ba-4246-8e54-c09b6cac0820" returned: 0 in 0.700s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:34 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bdd406cf-06a4-49a0-adfe-b6923e90f913 tempest-CinderUnicodeTest-492211907 None] Lock "cinder-quobyte-9b38c79b-69ba-4246-8e54-c09b6cac0820" released by "delete_volume" :: held 2.011s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:34 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-bdd406cf-06a4-49a0-adfe-b6923e90f913 tempest-CinderUnicodeTest-492211907 None] Created reservations ['685ffc2c-71c7-4f9a-a7f9-64acb4eb13d6', '36167486-d7c0-4178-a98f-6d08f748fd1e', '25ab0fad-9cf6-4433-a073-dbde2b9c7b0c', '0a1c42fc-19b3-47e8-9aba-2b9341095f92'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-bdd406cf-06a4-49a0-adfe-b6923e90f913 tempest-CinderUnicodeTest-492211907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-bdd406cf-06a4-49a0-adfe-b6923e90f913 tempest-CinderUnicodeTest-492211907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-bdd406cf-06a4-49a0-adfe-b6923e90f913 tempest-CinderUnicodeTest-492211907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-bdd406cf-06a4-49a0-adfe-b6923e90f913 tempest-CinderUnicodeTest-492211907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-bdd406cf-06a4-49a0-adfe-b6923e90f913 tempest-CinderUnicodeTest-492211907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bdd406cf-06a4-49a0-adfe-b6923e90f913 tempest-CinderUnicodeTest-492211907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:34 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:46:34 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:34 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-99beccf3-63f7-40dd-a2c7-b351e525efd3 tempest-ProjectReaderTests-1052592944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-805ceb41-17d2-409c-ba49-a529f78b93c1" returned: 0 in 0.810s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:34 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de 1073741824" returned: 0 in 1.092s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:34 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-99beccf3-63f7-40dd-a2c7-b351e525efd3 tempest-ProjectReaderTests-1052592944 None] Lock "cinder-quobyte-805ceb41-17d2-409c-ba49-a529f78b93c1" released by "delete_volume" :: held 2.004s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:34 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de Jul 10 00:46:34 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:34 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-99beccf3-63f7-40dd-a2c7-b351e525efd3 tempest-ProjectReaderTests-1052592944 None] Created reservations ['a5c06fbe-0c8b-4c50-ac99-109576e8f456', 'eafc1b8e-5c6e-4d5c-8f97-6918323ec8c4', '1f72c146-3199-431e-9c04-f28c8796b595', 'fe63e0a6-fdbf-4152-a513-2fcc3fd76376'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-99beccf3-63f7-40dd-a2c7-b351e525efd3 tempest-ProjectReaderTests-1052592944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-99beccf3-63f7-40dd-a2c7-b351e525efd3 tempest-ProjectReaderTests-1052592944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-99beccf3-63f7-40dd-a2c7-b351e525efd3 tempest-ProjectReaderTests-1052592944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-99beccf3-63f7-40dd-a2c7-b351e525efd3 tempest-ProjectReaderTests-1052592944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-99beccf3-63f7-40dd-a2c7-b351e525efd3 tempest-ProjectReaderTests-1052592944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-99beccf3-63f7-40dd-a2c7-b351e525efd3 tempest-ProjectReaderTests-1052592944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:34 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:46:34 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:35 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-bdd406cf-06a4-49a0-adfe-b6923e90f913 tempest-CinderUnicodeTest-492211907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.744s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-bdd406cf-06a4-49a0-adfe-b6923e90f913 tempest-CinderUnicodeTest-492211907 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:35 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-bdd406cf-06a4-49a0-adfe-b6923e90f913 tempest-CinderUnicodeTest-492211907 None] Deleted volume successfully. Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-bdd406cf-06a4-49a0-adfe-b6923e90f913 tempest-CinderUnicodeTest-492211907 None] Lock "cinder-9b38c79b-69ba-4246-8e54-c09b6cac0820-delete_volume" released by "delete_volume" :: held 3.057s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:35 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de" returned: 0 in 0.661s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd05d390-4fe1-42f3-b745-f0aed5f58c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db11a356-aec3-49b8-92f6-7241e7a614de', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b66c5fb-2598-4e6e-a1c7-54333aa3436c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:35 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Volume volume-db11a356-aec3-49b8-92f6-7241e7a614de (db11a356-aec3-49b8-92f6-7241e7a614de): created successfully Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b66c5fb-2598-4e6e-a1c7-54333aa3436c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Flow 'volume_create_manager' (c5607e75-0274-41ac-8713-3a6267c42d62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:35 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-986d6859-b426-4d15-85d0-7798a154bf64 tempest-VolumeDependencyTests-1531226867 None] Created volume successfully. Jul 10 00:46:35 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-99beccf3-63f7-40dd-a2c7-b351e525efd3 tempest-ProjectReaderTests-1052592944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.732s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-99beccf3-63f7-40dd-a2c7-b351e525efd3 tempest-ProjectReaderTests-1052592944 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:35 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-99beccf3-63f7-40dd-a2c7-b351e525efd3 tempest-ProjectReaderTests-1052592944 None] Deleted volume successfully. Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-99beccf3-63f7-40dd-a2c7-b351e525efd3 tempest-ProjectReaderTests-1052592944 None] Lock "cinder-805ceb41-17d2-409c-ba49-a529f78b93c1-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Flow 'volume_create_manager' (bce81438-25a3-4d6a-b7d2-456a48e2efcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00cbb6a-2710-4571-9bdb-83a6dbb4fef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00cbb6a-2710-4571-9bdb-83a6dbb4fef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1840547969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e429fe7b-cc81-43b3-9645-273015cbc27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f238e094d83c41769907fe7fe98cb92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:36Z,use_quota=True,user_id='6ae3ebc77379400a81756522642f35cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ea92ed-0898-453a-b875-323806a961ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ea92ed-0898-453a-b875-323806a961ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa6b888-5abb-461d-ad06-176f0b02c94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa6b888-5abb-461d-ad06-176f0b02c94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e429fe7b-cc81-43b3-9645-273015cbc27e', 'volume_name': 'volume-e429fe7b-cc81-43b3-9645-273015cbc27e', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e615f495-0002-4623-b8a2-1f86a01ef280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e615f495-0002-4623-b8a2-1f86a01ef280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f14c96da-1454-4bee-b48b-4ae8262ecca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:35 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Volume e429fe7b-cc81-43b3-9645-273015cbc27e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e429fe7b-cc81-43b3-9645-273015cbc27e', 'volume_size': 1} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1840547969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e429fe7b-cc81-43b3-9645-273015cbc27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f238e094d83c41769907fe7fe98cb92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:36Z,use_quota=True,user_id='6ae3ebc77379400a81756522642f35cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Creating volume e429fe7b-cc81-43b3-9645-273015cbc27e {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:46:35 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:46:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:35 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e 1073741824 Jul 10 00:46:35 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:36 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:46:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Flow 'volume_create_manager' (be60ed8e-3d94-4ac1-8a14-6663bd02ffed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (962960ff-6c8e-486c-b0be-ba5e4716c81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (962960ff-6c8e-486c-b0be-ba5e4716c81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-192317284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=806178c5-7244-4ecc-a5dd-d4c58094ef4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ddba97f683451bb34de66617558765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:36Z,use_quota=True,user_id='63ae47eec5994dd3b7598e353d8dd777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41288a9d-6042-41c1-8c26-75b9f60462df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41288a9d-6042-41c1-8c26-75b9f60462df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9399a7a2-5928-4e5e-b358-e0730d373044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9399a7a2-5928-4e5e-b358-e0730d373044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '806178c5-7244-4ecc-a5dd-d4c58094ef4a', 'volume_name': 'volume-806178c5-7244-4ecc-a5dd-d4c58094ef4a', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb80a9c-c5a1-4853-9500-343083af823d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb80a9c-c5a1-4853-9500-343083af823d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:36 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef2e719-34bc-4f5b-bce6-d22662c44fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:36 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Volume 806178c5-7244-4ecc-a5dd-d4c58094ef4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-806178c5-7244-4ecc-a5dd-d4c58094ef4a', 'volume_size': 1} Jul 10 00:46:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5adc5c0b-7119-457a-bc6a-7f159376efcf tempest-VolumeDependencyTests-1531226867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:36 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e 1073741824" returned: 0 in 0.982s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:36 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e Jul 10 00:46:36 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:37 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e" returned: 0 in 0.647s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:46:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.178s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-192317284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=806178c5-7244-4ecc-a5dd-d4c58094ef4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ddba97f683451bb34de66617558765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:36Z,use_quota=True,user_id='63ae47eec5994dd3b7598e353d8dd777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:46:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Creating volume 806178c5-7244-4ecc-a5dd-d4c58094ef4a {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:46:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:46:37 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:46:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-806178c5-7244-4ecc-a5dd-d4c58094ef4a 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:37 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-806178c5-7244-4ecc-a5dd-d4c58094ef4a 1073741824 Jul 10 00:46:37 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f14c96da-1454-4bee-b48b-4ae8262ecca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e429fe7b-cc81-43b3-9645-273015cbc27e', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2cf50a3-f3a1-424f-a97b-e15f8866ca84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:37 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Volume volume-e429fe7b-cc81-43b3-9645-273015cbc27e (e429fe7b-cc81-43b3-9645-273015cbc27e): created successfully Jul 10 00:46:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2cf50a3-f3a1-424f-a97b-e15f8866ca84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:37 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Flow 'volume_create_manager' (bce81438-25a3-4d6a-b7d2-456a48e2efcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:37 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-aaefa24f-1ea7-42b7-8058-59ce40e36230 tempest-ProjectMemberTests-1755578239 None] Created volume successfully. Jul 10 00:46:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-08a4704b-af32-4bd6-b554-5a8a61d8b169 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:38 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-806178c5-7244-4ecc-a5dd-d4c58094ef4a 1073741824" returned: 0 in 0.908s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-806178c5-7244-4ecc-a5dd-d4c58094ef4a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:38 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-806178c5-7244-4ecc-a5dd-d4c58094ef4a Jul 10 00:46:38 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:39 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-806178c5-7244-4ecc-a5dd-d4c58094ef4a" returned: 0 in 0.673s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:39 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:46:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5adc5c0b-7119-457a-bc6a-7f159376efcf tempest-VolumeDependencyTests-1531226867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.557s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ef2e719-34bc-4f5b-bce6-d22662c44fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-806178c5-7244-4ecc-a5dd-d4c58094ef4a', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c43fe2-4160-48a1-8e33-fbf95f1e3691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:39 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-5adc5c0b-7119-457a-bc6a-7f159376efcf tempest-VolumeDependencyTests-1531226867 None] Creating offline snapshot 649945e2-62f8-4e33-8473-316bdbd9f564 of volume db11a356-aec3-49b8-92f6-7241e7a614de {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:46:39 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Volume volume-806178c5-7244-4ecc-a5dd-d4c58094ef4a (806178c5-7244-4ecc-a5dd-d4c58094ef4a): created successfully Jul 10 00:46:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c43fe2-4160-48a1-8e33-fbf95f1e3691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:39 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Flow 'volume_create_manager' (be60ed8e-3d94-4ac1-8a14-6663bd02ffed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:39 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f108a5-7659-467a-9629-043011184ca0]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5adc5c0b-7119-457a-bc6a-7f159376efcf tempest-VolumeDependencyTests-1531226867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:39 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-1944ff37-177d-4174-bfbb-9203f6fda2fa tempest-ProjectReaderTests-1052592944 None] Created volume successfully. Jul 10 00:46:39 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de Jul 10 00:46:39 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:40 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5adc5c0b-7119-457a-bc6a-7f159376efcf tempest-VolumeDependencyTests-1531226867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de" returned: 0 in 0.798s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5adc5c0b-7119-457a-bc6a-7f159376efcf tempest-VolumeDependencyTests-1531226867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.649945e2-62f8-4e33-8473-316bdbd9f564 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:40 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.649945e2-62f8-4e33-8473-316bdbd9f564 1G Jul 10 00:46:40 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:40 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f1695d5d-c62f-40dc-97a8-a054d84f0a6f tempest-ProjectReaderTests-1052592944 None] Acquiring lock "cinder-806178c5-7244-4ecc-a5dd-d4c58094ef4a-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:40 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f1695d5d-c62f-40dc-97a8-a054d84f0a6f tempest-ProjectReaderTests-1052592944 None] Lock "cinder-806178c5-7244-4ecc-a5dd-d4c58094ef4a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:40 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f1695d5d-c62f-40dc-97a8-a054d84f0a6f tempest-ProjectReaderTests-1052592944 None] Acquiring lock "cinder-quobyte-806178c5-7244-4ecc-a5dd-d4c58094ef4a" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:40 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f1695d5d-c62f-40dc-97a8-a054d84f0a6f tempest-ProjectReaderTests-1052592944 None] Lock "cinder-quobyte-806178c5-7244-4ecc-a5dd-d4c58094ef4a" acquired by "delete_volume" :: waited 0.028s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:40 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a172954-6204-4387-84a6-699525692d5a]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f1695d5d-c62f-40dc-97a8-a054d84f0a6f tempest-ProjectReaderTests-1052592944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-806178c5-7244-4ecc-a5dd-d4c58094ef4a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:40 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-806178c5-7244-4ecc-a5dd-d4c58094ef4a Jul 10 00:46:40 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:40 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5adc5c0b-7119-457a-bc6a-7f159376efcf tempest-VolumeDependencyTests-1531226867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.649945e2-62f8-4e33-8473-316bdbd9f564 1G" returned: 0 in 0.960s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5adc5c0b-7119-457a-bc6a-7f159376efcf tempest-VolumeDependencyTests-1531226867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db11a356-aec3-49b8-92f6-7241e7a614de -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.649945e2-62f8-4e33-8473-316bdbd9f564 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:41 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db11a356-aec3-49b8-92f6-7241e7a614de -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.649945e2-62f8-4e33-8473-316bdbd9f564 Jul 10 00:46:41 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:41 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f1695d5d-c62f-40dc-97a8-a054d84f0a6f tempest-ProjectReaderTests-1052592944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-806178c5-7244-4ecc-a5dd-d4c58094ef4a" returned: 0 in 0.815s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f1695d5d-c62f-40dc-97a8-a054d84f0a6f tempest-ProjectReaderTests-1052592944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-806178c5-7244-4ecc-a5dd-d4c58094ef4a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:41 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-806178c5-7244-4ecc-a5dd-d4c58094ef4a Jul 10 00:46:41 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:41 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5adc5c0b-7119-457a-bc6a-7f159376efcf tempest-VolumeDependencyTests-1531226867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db11a356-aec3-49b8-92f6-7241e7a614de -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.649945e2-62f8-4e33-8473-316bdbd9f564" returned: 0 in 0.779s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:41 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-5adc5c0b-7119-457a-bc6a-7f159376efcf tempest-VolumeDependencyTests-1531226867 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.649945e2-62f8-4e33-8473-316bdbd9f564 is being set with open permissions: ugo+rw Jul 10 00:46:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5adc5c0b-7119-457a-bc6a-7f159376efcf tempest-VolumeDependencyTests-1531226867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.649945e2-62f8-4e33-8473-316bdbd9f564 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:41 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.649945e2-62f8-4e33-8473-316bdbd9f564 Jul 10 00:46:41 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:42 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f1695d5d-c62f-40dc-97a8-a054d84f0a6f tempest-ProjectReaderTests-1052592944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-806178c5-7244-4ecc-a5dd-d4c58094ef4a" returned: 0 in 0.824s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:42 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f1695d5d-c62f-40dc-97a8-a054d84f0a6f tempest-ProjectReaderTests-1052592944 None] Lock "cinder-quobyte-806178c5-7244-4ecc-a5dd-d4c58094ef4a" released by "delete_volume" :: held 1.698s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:42 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-f1695d5d-c62f-40dc-97a8-a054d84f0a6f tempest-ProjectReaderTests-1052592944 None] Created reservations ['e9ad3b0a-8900-42b8-9801-b0dddce6ec46', 'c01db1a6-937a-4380-8e0d-4df7c657254c', '4eb08e09-ab1a-4891-880e-d1513d11b54c', '6275abaf-5d0c-4cf9-8fb6-85b90a326ce8'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f1695d5d-c62f-40dc-97a8-a054d84f0a6f tempest-ProjectReaderTests-1052592944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f1695d5d-c62f-40dc-97a8-a054d84f0a6f tempest-ProjectReaderTests-1052592944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:42 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f1695d5d-c62f-40dc-97a8-a054d84f0a6f tempest-ProjectReaderTests-1052592944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:42 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f1695d5d-c62f-40dc-97a8-a054d84f0a6f tempest-ProjectReaderTests-1052592944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f1695d5d-c62f-40dc-97a8-a054d84f0a6f tempest-ProjectReaderTests-1052592944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f1695d5d-c62f-40dc-97a8-a054d84f0a6f tempest-ProjectReaderTests-1052592944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:42 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:46:42 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:42 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5adc5c0b-7119-457a-bc6a-7f159376efcf tempest-VolumeDependencyTests-1531226867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.649945e2-62f8-4e33-8473-316bdbd9f564" returned: 0 in 0.709s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5adc5c0b-7119-457a-bc6a-7f159376efcf tempest-VolumeDependencyTests-1531226867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:42 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.info Jul 10 00:46:42 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:43 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:43 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f1695d5d-c62f-40dc-97a8-a054d84f0a6f tempest-ProjectReaderTests-1052592944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.201s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5adc5c0b-7119-457a-bc6a-7f159376efcf tempest-VolumeDependencyTests-1531226867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.info" returned: 0 in 1.065s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:43 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-f1695d5d-c62f-40dc-97a8-a054d84f0a6f tempest-ProjectReaderTests-1052592944 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:43 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-5adc5c0b-7119-457a-bc6a-7f159376efcf tempest-VolumeDependencyTests-1531226867 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.info is being set with open permissions: ugo+rw Jul 10 00:46:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5adc5c0b-7119-457a-bc6a-7f159376efcf tempest-VolumeDependencyTests-1531226867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:43 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-f1695d5d-c62f-40dc-97a8-a054d84f0a6f tempest-ProjectReaderTests-1052592944 None] Deleted volume successfully. Jul 10 00:46:43 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.info Jul 10 00:46:43 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:43 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:46:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Flow 'volume_create_manager' (bf67525a-3264-412f-a473-cb7b338fe2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1326a82a-9ac2-4878-93b2-bc9680361bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f1695d5d-c62f-40dc-97a8-a054d84f0a6f tempest-ProjectReaderTests-1052592944 None] Lock "cinder-806178c5-7244-4ecc-a5dd-d4c58094ef4a-delete_volume" released by "delete_volume" :: held 3.255s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1326a82a-9ac2-4878-93b2-bc9680361bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-690887205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb34e86-c690-45b3-9d68-4c0402b239c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ddba97f683451bb34de66617558765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:44Z,use_quota=True,user_id='63ae47eec5994dd3b7598e353d8dd777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d41ec7-228b-497f-a590-dcd174388d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d41ec7-228b-497f-a590-dcd174388d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b590976-f4a3-4721-aef4-8b0376b04d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b590976-f4a3-4721-aef4-8b0376b04d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eb34e86-c690-45b3-9d68-4c0402b239c8', 'volume_name': 'volume-2eb34e86-c690-45b3-9d68-4c0402b239c8', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e6b80fc-923c-46df-81cc-c569be9acf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e6b80fc-923c-46df-81cc-c569be9acf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (089b5c93-01c3-4852-8780-89e0a5cc481b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:43 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Volume 2eb34e86-c690-45b3-9d68-4c0402b239c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eb34e86-c690-45b3-9d68-4c0402b239c8', 'volume_size': 1} Jul 10 00:46:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:44 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5adc5c0b-7119-457a-bc6a-7f159376efcf tempest-VolumeDependencyTests-1531226867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.info" returned: 0 in 0.773s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5adc5c0b-7119-457a-bc6a-7f159376efcf tempest-VolumeDependencyTests-1531226867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.255s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-08a4704b-af32-4bd6-b554-5a8a61d8b169 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.201s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:44 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-08a4704b-af32-4bd6-b554-5a8a61d8b169 tempest-ProjectMemberTests-1755578239 None] Creating offline snapshot b84b757d-0240-4aa2-9b1f-51728e9126cc of volume e429fe7b-cc81-43b3-9645-273015cbc27e {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:46:44 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-5adc5c0b-7119-457a-bc6a-7f159376efcf tempest-VolumeDependencyTests-1531226867 None] Create snapshot completed successfully Jul 10 00:46:44 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afc98ca-b755-40b8-a566-f07b44839189]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08a4704b-af32-4bd6-b554-5a8a61d8b169 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:44 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e Jul 10 00:46:44 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:45 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08a4704b-af32-4bd6-b554-5a8a61d8b169 tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e" returned: 0 in 0.931s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08a4704b-af32-4bd6-b554-5a8a61d8b169 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e.b84b757d-0240-4aa2-9b1f-51728e9126cc 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:45 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e.b84b757d-0240-4aa2-9b1f-51728e9126cc 1G Jul 10 00:46:45 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:45 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:46:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Flow 'volume_create_manager' (3aae4319-41a1-4a38-9f8e-1dce035104ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a274366-71f0-46e0-b44b-34cef6c6c630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a274366-71f0-46e0-b44b-34cef6c6c630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1307262447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7774de-455a-4727-a0ea-04e6ab8280da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b6c136f59b34f3385d38a9e5fc5aeef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=649945e2-62f8-4e33-8473-316bdbd9f564,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:46Z,use_quota=True,user_id='b00028b9100748dcad43994aa4e7518a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539c2f41-78e4-40f1-9e00-23af20db0539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539c2f41-78e4-40f1-9e00-23af20db0539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a7bcbba-67e1-48b9-a3cd-cc72efa3971c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a7bcbba-67e1-48b9-a3cd-cc72efa3971c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2b7774de-455a-4727-a0ea-04e6ab8280da', 'volume_name': 'volume-2b7774de-455a-4727-a0ea-04e6ab8280da', 'volume_size': 1, 'snapshot_id': '649945e2-62f8-4e33-8473-316bdbd9f564'}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94068be0-3aec-448d-a31b-a30a77917d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94068be0-3aec-448d-a31b-a30a77917d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2985676c-784a-46de-a110-2141d0d6003e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:45 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Volume 2b7774de-455a-4727-a0ea-04e6ab8280da: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2b7774de-455a-4727-a0ea-04e6ab8280da', 'volume_size': 1, 'snapshot_id': '649945e2-62f8-4e33-8473-316bdbd9f564'} Jul 10 00:46:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:46 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08a4704b-af32-4bd6-b554-5a8a61d8b169 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e.b84b757d-0240-4aa2-9b1f-51728e9126cc 1G" returned: 0 in 1.054s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08a4704b-af32-4bd6-b554-5a8a61d8b169 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e429fe7b-cc81-43b3-9645-273015cbc27e -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e.b84b757d-0240-4aa2-9b1f-51728e9126cc {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:46 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e429fe7b-cc81-43b3-9645-273015cbc27e -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e.b84b757d-0240-4aa2-9b1f-51728e9126cc Jul 10 00:46:46 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:47 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08a4704b-af32-4bd6-b554-5a8a61d8b169 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e429fe7b-cc81-43b3-9645-273015cbc27e -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e.b84b757d-0240-4aa2-9b1f-51728e9126cc" returned: 0 in 0.833s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:47 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-08a4704b-af32-4bd6-b554-5a8a61d8b169 tempest-ProjectMemberTests-1755578239 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e.b84b757d-0240-4aa2-9b1f-51728e9126cc is being set with open permissions: ugo+rw Jul 10 00:46:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08a4704b-af32-4bd6-b554-5a8a61d8b169 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e.b84b757d-0240-4aa2-9b1f-51728e9126cc {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:47 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e.b84b757d-0240-4aa2-9b1f-51728e9126cc Jul 10 00:46:47 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:47 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08a4704b-af32-4bd6-b554-5a8a61d8b169 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e.b84b757d-0240-4aa2-9b1f-51728e9126cc" returned: 0 in 0.662s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08a4704b-af32-4bd6-b554-5a8a61d8b169 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:48 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e.info Jul 10 00:46:48 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:48 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08a4704b-af32-4bd6-b554-5a8a61d8b169 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e.info" returned: 0 in 0.663s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:48 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-08a4704b-af32-4bd6-b554-5a8a61d8b169 tempest-ProjectMemberTests-1755578239 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e.info is being set with open permissions: ugo+rw Jul 10 00:46:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08a4704b-af32-4bd6-b554-5a8a61d8b169 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:48 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e.info Jul 10 00:46:48 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:49 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-08a4704b-af32-4bd6-b554-5a8a61d8b169 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e.info" returned: 0 in 0.684s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-08a4704b-af32-4bd6-b554-5a8a61d8b169 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.960s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.590s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-690887205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb34e86-c690-45b3-9d68-4c0402b239c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ddba97f683451bb34de66617558765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:44Z,use_quota=True,user_id='63ae47eec5994dd3b7598e353d8dd777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:46:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Creating volume 2eb34e86-c690-45b3-9d68-4c0402b239c8 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:46:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:46:49 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:46:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2eb34e86-c690-45b3-9d68-4c0402b239c8 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:49 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2eb34e86-c690-45b3-9d68-4c0402b239c8 1073741824 Jul 10 00:46:49 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:49 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-08a4704b-af32-4bd6-b554-5a8a61d8b169 tempest-ProjectMemberTests-1755578239 None] Create snapshot completed successfully Jul 10 00:46:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-64bc2d5b-5f3a-4f25-91a6-c2be5b7d2bfe tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-b84b757d-0240-4aa2-9b1f-51728e9126cc-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-64bc2d5b-5f3a-4f25-91a6-c2be5b7d2bfe tempest-ProjectMemberTests-1755578239 None] Lock "cinder-b84b757d-0240-4aa2-9b1f-51728e9126cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-64bc2d5b-5f3a-4f25-91a6-c2be5b7d2bfe tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-e429fe7b-cc81-43b3-9645-273015cbc27e" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-64bc2d5b-5f3a-4f25-91a6-c2be5b7d2bfe tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-e429fe7b-cc81-43b3-9645-273015cbc27e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-64bc2d5b-5f3a-4f25-91a6-c2be5b7d2bfe tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-b84b757d-0240-4aa2-9b1f-51728e9126cc" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-64bc2d5b-5f3a-4f25-91a6-c2be5b7d2bfe tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-b84b757d-0240-4aa2-9b1f-51728e9126cc" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-64bc2d5b-5f3a-4f25-91a6-c2be5b7d2bfe tempest-ProjectMemberTests-1755578239 None] Deleting offline snapshot b84b757d-0240-4aa2-9b1f-51728e9126cc of volume e429fe7b-cc81-43b3-9645-273015cbc27e {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:46:49 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-64bc2d5b-5f3a-4f25-91a6-c2be5b7d2bfe tempest-ProjectMemberTests-1755578239 None] snapshot_file for this snap is: volume-e429fe7b-cc81-43b3-9645-273015cbc27e.b84b757d-0240-4aa2-9b1f-51728e9126cc {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:46:49 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0416194-6f5d-47fa-b56b-3e6c657268d7]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-64bc2d5b-5f3a-4f25-91a6-c2be5b7d2bfe tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e.b84b757d-0240-4aa2-9b1f-51728e9126cc {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:50 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e.b84b757d-0240-4aa2-9b1f-51728e9126cc Jul 10 00:46:50 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:50 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2eb34e86-c690-45b3-9d68-4c0402b239c8 1073741824" returned: 0 in 0.930s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2eb34e86-c690-45b3-9d68-4c0402b239c8 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:50 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2eb34e86-c690-45b3-9d68-4c0402b239c8 Jul 10 00:46:50 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:50 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-64bc2d5b-5f3a-4f25-91a6-c2be5b7d2bfe tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e.b84b757d-0240-4aa2-9b1f-51728e9126cc" returned: 0 in 0.850s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-64bc2d5b-5f3a-4f25-91a6-c2be5b7d2bfe tempest-ProjectMemberTests-1755578239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e429fe7b-cc81-43b3-9645-273015cbc27e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:46:50 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8da7791-df65-45a0-8955-ca44a0614a48]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-64bc2d5b-5f3a-4f25-91a6-c2be5b7d2bfe tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:50 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e Jul 10 00:46:50 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:51 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2eb34e86-c690-45b3-9d68-4c0402b239c8" returned: 0 in 0.739s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.113s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Acquiring lock "cinder-quobyte-649945e2-62f8-4e33-8473-316bdbd9f564-2b7774de-455a-4727-a0ea-04e6ab8280da" by "_create_volume_from_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Lock "cinder-quobyte-649945e2-62f8-4e33-8473-316bdbd9f564-2b7774de-455a-4727-a0ea-04e6ab8280da" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Creating volume 2b7774de-455a-4727-a0ea-04e6ab8280da from snapshot 649945e2-62f8-4e33-8473-316bdbd9f564 {{(pid=88119) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Acquiring lock "cinder-quobyte-2b7774de-455a-4727-a0ea-04e6ab8280da" by "_copy_volume_from_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (089b5c93-01c3-4852-8780-89e0a5cc481b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eb34e86-c690-45b3-9d68-4c0402b239c8', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fcf8a3c-58a1-4651-b596-905867ec47f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Lock "cinder-quobyte-2b7774de-455a-4727-a0ea-04e6ab8280da" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] snapshot: 649945e2-62f8-4e33-8473-316bdbd9f564, volume: 2b7774de-455a-4727-a0ea-04e6ab8280da, {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 00:46:51 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Volume volume-2eb34e86-c690-45b3-9d68-4c0402b239c8 (2eb34e86-c690-45b3-9d68-4c0402b239c8): created successfully Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fcf8a3c-58a1-4651-b596-905867ec47f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Flow 'volume_create_manager' (bf67525a-3264-412f-a473-cb7b338fe2c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:51 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-0f175b84-ffbf-43a8-b4c1-8499fa81d66e tempest-ProjectReaderTests-1052592944 None] Created volume successfully. Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea94874-3e0d-4cb0-8dcc-68e5f9fc3fd0]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.649945e2-62f8-4e33-8473-316bdbd9f564 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:51 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.649945e2-62f8-4e33-8473-316bdbd9f564 Jul 10 00:46:51 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:51 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-64bc2d5b-5f3a-4f25-91a6-c2be5b7d2bfe tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e" returned: 0 in 0.932s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-64bc2d5b-5f3a-4f25-91a6-c2be5b7d2bfe tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e.b84b757d-0240-4aa2-9b1f-51728e9126cc {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:51 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e.b84b757d-0240-4aa2-9b1f-51728e9126cc Jul 10 00:46:51 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:52 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.649945e2-62f8-4e33-8473-316bdbd9f564" returned: 0 in 0.933s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:52 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db11a356-aec3-49b8-92f6-7241e7a614de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:46:52 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 00:46:52 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Creating direct copy from snapshot {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 00:46:52 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f48aa7-c18e-4adc-9d4c-810ab832c43f]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-28477286-20e6-4e92-853b-95d0f16a355b tempest-ProjectReaderTests-1052592944 None] Acquiring lock "cinder-2eb34e86-c690-45b3-9d68-4c0402b239c8-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-28477286-20e6-4e92-853b-95d0f16a355b tempest-ProjectReaderTests-1052592944 None] Lock "cinder-2eb34e86-c690-45b3-9d68-4c0402b239c8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-28477286-20e6-4e92-853b-95d0f16a355b tempest-ProjectReaderTests-1052592944 None] Acquiring lock "cinder-quobyte-2eb34e86-c690-45b3-9d68-4c0402b239c8" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:52 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-28477286-20e6-4e92-853b-95d0f16a355b tempest-ProjectReaderTests-1052592944 None] Lock "cinder-quobyte-2eb34e86-c690-45b3-9d68-4c0402b239c8" acquired by "delete_volume" :: waited 0.014s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:52 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6899da41-a6ac-42d9-a2b5-6d72ad091d01]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-28477286-20e6-4e92-853b-95d0f16a355b tempest-ProjectReaderTests-1052592944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2eb34e86-c690-45b3-9d68-4c0402b239c8 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:52 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de Jul 10 00:46:52 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:52 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2eb34e86-c690-45b3-9d68-4c0402b239c8 Jul 10 00:46:52 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:52 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-64bc2d5b-5f3a-4f25-91a6-c2be5b7d2bfe tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e.b84b757d-0240-4aa2-9b1f-51728e9126cc" returned: 0 in 0.856s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-64bc2d5b-5f3a-4f25-91a6-c2be5b7d2bfe tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e.b84b757d-0240-4aa2-9b1f-51728e9126cc {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:52 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e.b84b757d-0240-4aa2-9b1f-51728e9126cc Jul 10 00:46:52 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:53 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de" returned: 0 in 1.072s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:53 devstack cinder-volume[88119]: DEBUG cinder.utils [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Path /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2b7774de-455a-4727-a0ea-04e6ab8280da not found in is_blk_device check {{(pid=88119) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 00:46:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2b7774de-455a-4727-a0ea-04e6ab8280da {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:53 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2b7774de-455a-4727-a0ea-04e6ab8280da Jul 10 00:46:53 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:53 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-28477286-20e6-4e92-853b-95d0f16a355b tempest-ProjectReaderTests-1052592944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2eb34e86-c690-45b3-9d68-4c0402b239c8" returned: 0 in 1.073s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-28477286-20e6-4e92-853b-95d0f16a355b tempest-ProjectReaderTests-1052592944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2eb34e86-c690-45b3-9d68-4c0402b239c8 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:53 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2eb34e86-c690-45b3-9d68-4c0402b239c8 Jul 10 00:46:53 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:53 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-64bc2d5b-5f3a-4f25-91a6-c2be5b7d2bfe tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e.b84b757d-0240-4aa2-9b1f-51728e9126cc" returned: 0 in 1.030s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-64bc2d5b-5f3a-4f25-91a6-c2be5b7d2bfe tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-b84b757d-0240-4aa2-9b1f-51728e9126cc" released by "_delete_snapshot" :: held 3.847s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-64bc2d5b-5f3a-4f25-91a6-c2be5b7d2bfe tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-e429fe7b-cc81-43b3-9645-273015cbc27e" released by "delete_snapshot" :: held 3.887s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:53 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-64bc2d5b-5f3a-4f25-91a6-c2be5b7d2bfe tempest-ProjectMemberTests-1755578239 None] Created reservations ['f04d0daf-e49c-481c-b663-fbcaea0460af', '3ac9dc4f-2c15-4843-b343-c1575b7050d8', 'd029b52b-369d-44b8-88c7-da2ede64438b', '77527b8c-6ec3-4b72-88e4-e2222046ca20'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:53 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-64bc2d5b-5f3a-4f25-91a6-c2be5b7d2bfe tempest-ProjectMemberTests-1755578239 None] Delete snapshot completed successfully. Jul 10 00:46:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-64bc2d5b-5f3a-4f25-91a6-c2be5b7d2bfe tempest-ProjectMemberTests-1755578239 None] Lock "cinder-b84b757d-0240-4aa2-9b1f-51728e9126cc-delete_snapshot" released by "delete_snapshot" :: held 4.119s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b6e860c0-46ae-4f25-a695-7512df418f49 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-e429fe7b-cc81-43b3-9645-273015cbc27e-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b6e860c0-46ae-4f25-a695-7512df418f49 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-e429fe7b-cc81-43b3-9645-273015cbc27e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b6e860c0-46ae-4f25-a695-7512df418f49 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-e429fe7b-cc81-43b3-9645-273015cbc27e" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:46:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b6e860c0-46ae-4f25-a695-7512df418f49 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-e429fe7b-cc81-43b3-9645-273015cbc27e" acquired by "delete_volume" :: waited 0.024s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:46:54 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[18787d5c-fe00-4ad1-9ccd-260cdda66efa]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:46:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b6e860c0-46ae-4f25-a695-7512df418f49 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:54 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e Jul 10 00:46:54 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:55 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-28477286-20e6-4e92-853b-95d0f16a355b tempest-ProjectReaderTests-1052592944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2eb34e86-c690-45b3-9d68-4c0402b239c8" returned: 0 in 1.777s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:55 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-28477286-20e6-4e92-853b-95d0f16a355b tempest-ProjectReaderTests-1052592944 None] Lock "cinder-quobyte-2eb34e86-c690-45b3-9d68-4c0402b239c8" released by "delete_volume" :: held 2.949s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:55 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-28477286-20e6-4e92-853b-95d0f16a355b tempest-ProjectReaderTests-1052592944 None] Created reservations ['b1d2aeb7-1c0f-4db6-bac3-52d356cbecc3', '18ab4a1e-eb91-4b93-99c5-706b3eeccbbe', 'bdd7e6ab-bff7-4104-9b66-5c1227262850', '37686a22-d071-4851-a5f7-385491f0f22b'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-28477286-20e6-4e92-853b-95d0f16a355b tempest-ProjectReaderTests-1052592944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-28477286-20e6-4e92-853b-95d0f16a355b tempest-ProjectReaderTests-1052592944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:55 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-28477286-20e6-4e92-853b-95d0f16a355b tempest-ProjectReaderTests-1052592944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:55 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-28477286-20e6-4e92-853b-95d0f16a355b tempest-ProjectReaderTests-1052592944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-28477286-20e6-4e92-853b-95d0f16a355b tempest-ProjectReaderTests-1052592944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-28477286-20e6-4e92-853b-95d0f16a355b tempest-ProjectReaderTests-1052592944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:55 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:46:55 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:56 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b6e860c0-46ae-4f25-a695-7512df418f49 tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e" returned: 0 in 2.103s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b6e860c0-46ae-4f25-a695-7512df418f49 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:56 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e Jul 10 00:46:56 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:57 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b6e860c0-46ae-4f25-a695-7512df418f49 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-e429fe7b-cc81-43b3-9645-273015cbc27e" returned: 0 in 1.471s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:57 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b6e860c0-46ae-4f25-a695-7512df418f49 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-e429fe7b-cc81-43b3-9645-273015cbc27e" released by "delete_volume" :: held 3.721s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:58 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-b6e860c0-46ae-4f25-a695-7512df418f49 tempest-ProjectMemberTests-1755578239 None] Created reservations ['4cf00919-ba80-4f56-a3ff-9b30c66fb52e', '1de68d71-94a0-430b-b575-fe0aac1d422c', '9be2e79e-ea87-4732-863d-cf059d8c894f', '452bac61-fa83-4698-8cbe-edd7cfdf611e'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:46:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b6e860c0-46ae-4f25-a695-7512df418f49 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:46:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b6e860c0-46ae-4f25-a695-7512df418f49 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:46:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b6e860c0-46ae-4f25-a695-7512df418f49 tempest-ProjectMemberTests-1755578239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:46:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b6e860c0-46ae-4f25-a695-7512df418f49 tempest-ProjectMemberTests-1755578239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:46:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b6e860c0-46ae-4f25-a695-7512df418f49 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:46:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b6e860c0-46ae-4f25-a695-7512df418f49 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:46:58 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Jul 10 00:46:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-28477286-20e6-4e92-853b-95d0f16a355b tempest-ProjectReaderTests-1052592944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 2.499s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:46:58 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-28477286-20e6-4e92-853b-95d0f16a355b tempest-ProjectReaderTests-1052592944 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:46:58 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-28477286-20e6-4e92-853b-95d0f16a355b tempest-ProjectReaderTests-1052592944 None] Deleted volume successfully. Jul 10 00:46:58 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:46:58 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:46:58 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-28477286-20e6-4e92-853b-95d0f16a355b tempest-ProjectReaderTests-1052592944 None] Lock "cinder-2eb34e86-c690-45b3-9d68-4c0402b239c8-delete_volume" released by "delete_volume" :: held 6.196s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:46:59 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:46:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Flow 'volume_create_manager' (1bcaee2b-83e6-40d5-8ceb-7153d257a922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:46:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71b222c-aab3-4067-a67e-8c454745a333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71b222c-aab3-4067-a67e-8c454745a333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1132024084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09fecbf7-4eee-479e-a4f4-1fa83722ec83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ddba97f683451bb34de66617558765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:59Z,use_quota=True,user_id='63ae47eec5994dd3b7598e353d8dd777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5259c035-7084-4a3f-947f-edbd4540c0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5259c035-7084-4a3f-947f-edbd4540c0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0512330c-85a2-4096-9b13-1a905f39b678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0512330c-85a2-4096-9b13-1a905f39b678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09fecbf7-4eee-479e-a4f4-1fa83722ec83', 'volume_name': 'volume-09fecbf7-4eee-479e-a4f4-1fa83722ec83', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ddbbc43-cdbe-4d0a-a2d6-4186a5044df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ddbbc43-cdbe-4d0a-a2d6-4186a5044df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:46:59 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e148714-f3a9-4131-95f7-da8ec5a41a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:46:59 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Volume 09fecbf7-4eee-479e-a4f4-1fa83722ec83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09fecbf7-4eee-479e-a4f4-1fa83722ec83', 'volume_size': 1} Jul 10 00:46:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:00 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b6e860c0-46ae-4f25-a695-7512df418f49 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 1.820s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:00 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-b6e860c0-46ae-4f25-a695-7512df418f49 tempest-ProjectMemberTests-1755578239 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:47:00 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-b6e860c0-46ae-4f25-a695-7512df418f49 tempest-ProjectMemberTests-1755578239 None] Deleted volume successfully. Jul 10 00:47:00 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b6e860c0-46ae-4f25-a695-7512df418f49 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-e429fe7b-cc81-43b3-9645-273015cbc27e-delete_volume" released by "delete_volume" :: held 6.073s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:00 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2b7774de-455a-4727-a0ea-04e6ab8280da" returned: 0 in 7.032s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:00 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:47:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Flow 'volume_create_manager' (5ddd9ede-dfc8-4447-8781-054bdea3cc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc99ff7-e8e0-4991-83ec-02dd957a1f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:00 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a1adc5-2220-474b-b91c-3527e95e555e]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc99ff7-e8e0-4991-83ec-02dd957a1f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-776788156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34760940-ffc9-4e2c-a158-eb02b13bbc8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f238e094d83c41769907fe7fe98cb92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:00Z,use_quota=True,user_id='6ae3ebc77379400a81756522642f35cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8801b4f-af1c-46c7-a6c3-fd2e2d52b26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8801b4f-af1c-46c7-a6c3-fd2e2d52b26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5adfb49e-9d55-4c4d-a3fd-1b259bbcad08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5adfb49e-9d55-4c4d-a3fd-1b259bbcad08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34760940-ffc9-4e2c-a158-eb02b13bbc8f', 'volume_name': 'volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1434bd0-de01-4455-9f15-848fc7213ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1434bd0-de01-4455-9f15-848fc7213ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b76a5e-794e-442b-a493-4dc89edf3751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:00 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Volume 34760940-ffc9-4e2c-a158-eb02b13bbc8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f', 'volume_size': 1} Jul 10 00:47:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:00 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de Jul 10 00:47:00 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:01 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de" returned: 0 in 0.977s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:01 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Image conversion details: src /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de, size 1024.00 MB, duration 7.03 sec, destination /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2b7774de-455a-4727-a0ea-04e6ab8280da {{(pid=88119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:47:01 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Converted 1024.00 MB image at 145.60 MB/s Jul 10 00:47:01 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2b7774de-455a-4727-a0ea-04e6ab8280da is being set with open permissions: ugo+rw Jul 10 00:47:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2b7774de-455a-4727-a0ea-04e6ab8280da {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:01 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2b7774de-455a-4727-a0ea-04e6ab8280da Jul 10 00:47:01 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:01 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2b7774de-455a-4727-a0ea-04e6ab8280da" returned: 0 in 0.659s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:01 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Lock "cinder-quobyte-2b7774de-455a-4727-a0ea-04e6ab8280da" released by "_copy_volume_from_snapshot" :: held 10.836s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:01 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Lock "cinder-quobyte-649945e2-62f8-4e33-8473-316bdbd9f564-2b7774de-455a-4727-a0ea-04e6ab8280da" released by "_create_volume_from_snapshot" :: held 10.881s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.903s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.818s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:01 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1132024084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09fecbf7-4eee-479e-a4f4-1fa83722ec83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ddba97f683451bb34de66617558765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:46:59Z,use_quota=True,user_id='63ae47eec5994dd3b7598e353d8dd777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:47:01 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Creating volume 09fecbf7-4eee-479e-a4f4-1fa83722ec83 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:47:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:01 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:01 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:01 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:47:01 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:47:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-09fecbf7-4eee-479e-a4f4-1fa83722ec83 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:02 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-09fecbf7-4eee-479e-a4f4-1fa83722ec83 1073741824 Jul 10 00:47:02 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2985676c-784a-46de-a110-2141d0d6003e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b7774de-455a-4727-a0ea-04e6ab8280da', 'volume_size': 1, 'snapshot_id': '649945e2-62f8-4e33-8473-316bdbd9f564'}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d9d7e4-4aa6-4f2d-b969-696f27956343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:02 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Volume volume-2b7774de-455a-4727-a0ea-04e6ab8280da (2b7774de-455a-4727-a0ea-04e6ab8280da): created successfully Jul 10 00:47:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d9d7e4-4aa6-4f2d-b969-696f27956343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:02 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Flow 'volume_create_manager' (3aae4319-41a1-4a38-9f8e-1dce035104ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:02 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-d46c22f2-236c-42d9-bcd9-7b48598081ff tempest-VolumeDependencyTests-1531226867 None] Created volume successfully. Jul 10 00:47:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c0e7e17c-74e3-49bc-98e4-b07713b952cb tempest-VolumeDependencyTests-1531226867 None] Acquiring lock "cinder-649945e2-62f8-4e33-8473-316bdbd9f564-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c0e7e17c-74e3-49bc-98e4-b07713b952cb tempest-VolumeDependencyTests-1531226867 None] Lock "cinder-649945e2-62f8-4e33-8473-316bdbd9f564-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c0e7e17c-74e3-49bc-98e4-b07713b952cb tempest-VolumeDependencyTests-1531226867 None] Acquiring lock "cinder-quobyte-db11a356-aec3-49b8-92f6-7241e7a614de" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c0e7e17c-74e3-49bc-98e4-b07713b952cb tempest-VolumeDependencyTests-1531226867 None] Lock "cinder-quobyte-db11a356-aec3-49b8-92f6-7241e7a614de" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c0e7e17c-74e3-49bc-98e4-b07713b952cb tempest-VolumeDependencyTests-1531226867 None] Acquiring lock "cinder-quobyte-649945e2-62f8-4e33-8473-316bdbd9f564" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c0e7e17c-74e3-49bc-98e4-b07713b952cb tempest-VolumeDependencyTests-1531226867 None] Lock "cinder-quobyte-649945e2-62f8-4e33-8473-316bdbd9f564" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-c0e7e17c-74e3-49bc-98e4-b07713b952cb tempest-VolumeDependencyTests-1531226867 None] Deleting offline snapshot 649945e2-62f8-4e33-8473-316bdbd9f564 of volume db11a356-aec3-49b8-92f6-7241e7a614de {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:47:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-c0e7e17c-74e3-49bc-98e4-b07713b952cb tempest-VolumeDependencyTests-1531226867 None] snapshot_file for this snap is: volume-db11a356-aec3-49b8-92f6-7241e7a614de.649945e2-62f8-4e33-8473-316bdbd9f564 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:47:02 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f0fc22-8c2e-4121-9568-e1e742846f7e]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c0e7e17c-74e3-49bc-98e4-b07713b952cb tempest-VolumeDependencyTests-1531226867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.649945e2-62f8-4e33-8473-316bdbd9f564 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:02 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.649945e2-62f8-4e33-8473-316bdbd9f564 Jul 10 00:47:02 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:03 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-09fecbf7-4eee-479e-a4f4-1fa83722ec83 1073741824" returned: 0 in 1.037s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-09fecbf7-4eee-479e-a4f4-1fa83722ec83 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:03 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-09fecbf7-4eee-479e-a4f4-1fa83722ec83 Jul 10 00:47:03 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:03 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c0e7e17c-74e3-49bc-98e4-b07713b952cb tempest-VolumeDependencyTests-1531226867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.649945e2-62f8-4e33-8473-316bdbd9f564" returned: 0 in 0.902s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-c0e7e17c-74e3-49bc-98e4-b07713b952cb tempest-VolumeDependencyTests-1531226867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db11a356-aec3-49b8-92f6-7241e7a614de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:47:03 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb28a933-e9b7-497c-b8ab-8164ca0b1dda]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c0e7e17c-74e3-49bc-98e4-b07713b952cb tempest-VolumeDependencyTests-1531226867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:03 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de Jul 10 00:47:03 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:03 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-09fecbf7-4eee-479e-a4f4-1fa83722ec83" returned: 0 in 0.770s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:47:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.465s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-776788156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34760940-ffc9-4e2c-a158-eb02b13bbc8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f238e094d83c41769907fe7fe98cb92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:00Z,use_quota=True,user_id='6ae3ebc77379400a81756522642f35cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:47:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Creating volume 34760940-ffc9-4e2c-a158-eb02b13bbc8f {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:47:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:03 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:47:03 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:47:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:03 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f 1073741824 Jul 10 00:47:03 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e148714-f3a9-4131-95f7-da8ec5a41a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09fecbf7-4eee-479e-a4f4-1fa83722ec83', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9fcb56-9da0-4200-b346-8fab9b39f6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:03 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Volume volume-09fecbf7-4eee-479e-a4f4-1fa83722ec83 (09fecbf7-4eee-479e-a4f4-1fa83722ec83): created successfully Jul 10 00:47:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9fcb56-9da0-4200-b346-8fab9b39f6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:03 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Flow 'volume_create_manager' (1bcaee2b-83e6-40d5-8ceb-7153d257a922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:03 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-cee641b0-546c-4c37-b230-8177e2d1ca89 tempest-ProjectReaderTests-1052592944 None] Created volume successfully. Jul 10 00:47:04 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:47:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Flow 'volume_create_manager' (3f9d9b01-8e8c-4ccb-9d15-f868e635b014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10b5d18d-58e2-43ab-ae0a-59e06de3cc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10b5d18d-58e2-43ab-ae0a-59e06de3cc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-354488859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06a00a68-e351-48b1-a9ee-575b96e4696b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01399e7403db41c89fe94e8e30b1e6d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:04Z,use_quota=True,user_id='9867f2d3f143439384c7778b2b7ff966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73468f8-e09b-4ed4-a737-93ed28915a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73468f8-e09b-4ed4-a737-93ed28915a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e45001-4ae2-4d38-8f59-8614edd76925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e45001-4ae2-4d38-8f59-8614edd76925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06a00a68-e351-48b1-a9ee-575b96e4696b', 'volume_name': 'volume-06a00a68-e351-48b1-a9ee-575b96e4696b', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46cf06d-01cd-4817-9227-de2e144ccfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46cf06d-01cd-4817-9227-de2e144ccfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:04 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8557159-dce3-4588-aae6-f0419e318b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:04 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Volume 06a00a68-e351-48b1-a9ee-575b96e4696b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06a00a68-e351-48b1-a9ee-575b96e4696b', 'volume_size': 1} Jul 10 00:47:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:04 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c0e7e17c-74e3-49bc-98e4-b07713b952cb tempest-VolumeDependencyTests-1531226867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de" returned: 0 in 0.828s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c0e7e17c-74e3-49bc-98e4-b07713b952cb tempest-VolumeDependencyTests-1531226867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.649945e2-62f8-4e33-8473-316bdbd9f564 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:04 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.649945e2-62f8-4e33-8473-316bdbd9f564 Jul 10 00:47:04 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:04 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f 1073741824" returned: 0 in 0.885s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:04 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f Jul 10 00:47:04 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:05 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c0e7e17c-74e3-49bc-98e4-b07713b952cb tempest-VolumeDependencyTests-1531226867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.649945e2-62f8-4e33-8473-316bdbd9f564" returned: 0 in 0.775s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c0e7e17c-74e3-49bc-98e4-b07713b952cb tempest-VolumeDependencyTests-1531226867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.649945e2-62f8-4e33-8473-316bdbd9f564 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:05 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.649945e2-62f8-4e33-8473-316bdbd9f564 Jul 10 00:47:05 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b2f17b67-8be5-44c5-8adb-49293d7a21fb tempest-ProjectReaderTests-1052592944 None] Acquiring lock "cinder-09fecbf7-4eee-479e-a4f4-1fa83722ec83-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b2f17b67-8be5-44c5-8adb-49293d7a21fb tempest-ProjectReaderTests-1052592944 None] Lock "cinder-09fecbf7-4eee-479e-a4f4-1fa83722ec83-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b2f17b67-8be5-44c5-8adb-49293d7a21fb tempest-ProjectReaderTests-1052592944 None] Acquiring lock "cinder-quobyte-09fecbf7-4eee-479e-a4f4-1fa83722ec83" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b2f17b67-8be5-44c5-8adb-49293d7a21fb tempest-ProjectReaderTests-1052592944 None] Lock "cinder-quobyte-09fecbf7-4eee-479e-a4f4-1fa83722ec83" acquired by "delete_volume" :: waited 0.017s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[38065528-08af-440e-91d6-c5488b97e62a]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b2f17b67-8be5-44c5-8adb-49293d7a21fb tempest-ProjectReaderTests-1052592944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-09fecbf7-4eee-479e-a4f4-1fa83722ec83 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:05 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-09fecbf7-4eee-479e-a4f4-1fa83722ec83 Jul 10 00:47:05 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:05 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f" returned: 0 in 0.705s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.228s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-354488859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06a00a68-e351-48b1-a9ee-575b96e4696b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01399e7403db41c89fe94e8e30b1e6d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:04Z,use_quota=True,user_id='9867f2d3f143439384c7778b2b7ff966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Creating volume 06a00a68-e351-48b1-a9ee-575b96e4696b {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:47:05 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b76a5e-794e-442b-a493-4dc89edf3751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:05 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b 1073741824 Jul 10 00:47:05 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e893e44e-67b7-4012-b7bf-46fbf59715a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:05 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Volume volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f (34760940-ffc9-4e2c-a158-eb02b13bbc8f): created successfully Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e893e44e-67b7-4012-b7bf-46fbf59715a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Flow 'volume_create_manager' (5ddd9ede-dfc8-4447-8781-054bdea3cc18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:05 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-1d0076f9-ceba-4fb0-a98e-5fee9a1dd7ea tempest-ProjectMemberTests-1755578239 None] Created volume successfully. Jul 10 00:47:05 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c0e7e17c-74e3-49bc-98e4-b07713b952cb tempest-VolumeDependencyTests-1531226867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de.649945e2-62f8-4e33-8473-316bdbd9f564" returned: 0 in 0.762s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c0e7e17c-74e3-49bc-98e4-b07713b952cb tempest-VolumeDependencyTests-1531226867 None] Lock "cinder-quobyte-649945e2-62f8-4e33-8473-316bdbd9f564" released by "_delete_snapshot" :: held 3.386s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c0e7e17c-74e3-49bc-98e4-b07713b952cb tempest-VolumeDependencyTests-1531226867 None] Lock "cinder-quobyte-db11a356-aec3-49b8-92f6-7241e7a614de" released by "delete_snapshot" :: held 3.411s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:05 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-c0e7e17c-74e3-49bc-98e4-b07713b952cb tempest-VolumeDependencyTests-1531226867 None] Created reservations ['1d9c808d-f80f-4c65-b550-1f98cb83f6ce', '49d171bc-f244-4ebf-aefd-e9bf17deddea', '130b9cbe-427c-404b-94cf-04616f10ff71', 'a9348181-03df-4fbb-8d7e-30e3531bf3e5'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:47:06 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-c0e7e17c-74e3-49bc-98e4-b07713b952cb tempest-VolumeDependencyTests-1531226867 None] Delete snapshot completed successfully. Jul 10 00:47:06 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c0e7e17c-74e3-49bc-98e4-b07713b952cb tempest-VolumeDependencyTests-1531226867 None] Lock "cinder-649945e2-62f8-4e33-8473-316bdbd9f564-delete_snapshot" released by "delete_snapshot" :: held 3.572s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:06 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b2f17b67-8be5-44c5-8adb-49293d7a21fb tempest-ProjectReaderTests-1052592944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-09fecbf7-4eee-479e-a4f4-1fa83722ec83" returned: 0 in 0.852s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b2f17b67-8be5-44c5-8adb-49293d7a21fb tempest-ProjectReaderTests-1052592944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-09fecbf7-4eee-479e-a4f4-1fa83722ec83 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:06 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-09fecbf7-4eee-479e-a4f4-1fa83722ec83 Jul 10 00:47:06 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:06 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b 1073741824" returned: 0 in 0.845s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:06 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b Jul 10 00:47:06 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c611a257-938e-4eea-a311-a932e0886290 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:06 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-72aff970-9da9-4a2b-9e3e-82843bb6e54c tempest-VolumeDependencyTests-1531226867 None] Acquiring lock "cinder-db11a356-aec3-49b8-92f6-7241e7a614de-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:06 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-72aff970-9da9-4a2b-9e3e-82843bb6e54c tempest-VolumeDependencyTests-1531226867 None] Lock "cinder-db11a356-aec3-49b8-92f6-7241e7a614de-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:06 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-72aff970-9da9-4a2b-9e3e-82843bb6e54c tempest-VolumeDependencyTests-1531226867 None] Acquiring lock "cinder-quobyte-db11a356-aec3-49b8-92f6-7241e7a614de" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:06 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-72aff970-9da9-4a2b-9e3e-82843bb6e54c tempest-VolumeDependencyTests-1531226867 None] Lock "cinder-quobyte-db11a356-aec3-49b8-92f6-7241e7a614de" acquired by "delete_volume" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:06 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b2f17b67-8be5-44c5-8adb-49293d7a21fb tempest-ProjectReaderTests-1052592944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-09fecbf7-4eee-479e-a4f4-1fa83722ec83" returned: 0 in 0.749s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:06 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4543696-a96e-4f59-ad67-6fb4898b5945]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-72aff970-9da9-4a2b-9e3e-82843bb6e54c tempest-VolumeDependencyTests-1531226867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:06 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b2f17b67-8be5-44c5-8adb-49293d7a21fb tempest-ProjectReaderTests-1052592944 None] Lock "cinder-quobyte-09fecbf7-4eee-479e-a4f4-1fa83722ec83" released by "delete_volume" :: held 1.651s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:06 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-b2f17b67-8be5-44c5-8adb-49293d7a21fb tempest-ProjectReaderTests-1052592944 None] Created reservations ['2c721d62-f682-4df4-8322-99e1733461dd', '2d2cdf6f-9a5b-4139-9e7c-dd961a0e633a', '356644b0-c8ac-4d67-90f7-1bd81cde590c', '7d85c6db-4881-4cfa-bf17-49e51ae87124'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:47:06 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de Jul 10 00:47:06 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b2f17b67-8be5-44c5-8adb-49293d7a21fb tempest-ProjectReaderTests-1052592944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b2f17b67-8be5-44c5-8adb-49293d7a21fb tempest-ProjectReaderTests-1052592944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b2f17b67-8be5-44c5-8adb-49293d7a21fb tempest-ProjectReaderTests-1052592944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b2f17b67-8be5-44c5-8adb-49293d7a21fb tempest-ProjectReaderTests-1052592944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b2f17b67-8be5-44c5-8adb-49293d7a21fb tempest-ProjectReaderTests-1052592944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b2f17b67-8be5-44c5-8adb-49293d7a21fb tempest-ProjectReaderTests-1052592944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:07 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:47:07 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:07 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b" returned: 0 in 0.715s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:47:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c611a257-938e-4eea-a311-a932e0886290 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.381s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-c611a257-938e-4eea-a311-a932e0886290 tempest-ProjectMemberTests-1755578239 None] Creating offline snapshot 8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99 of volume 34760940-ffc9-4e2c-a158-eb02b13bbc8f {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:47:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8557159-dce3-4588-aae6-f0419e318b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06a00a68-e351-48b1-a9ee-575b96e4696b', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de650a3-6ebc-4630-bf09-4b91ed95723c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:07 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b50d1f8-395e-4030-825f-3989d2559937]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c611a257-938e-4eea-a311-a932e0886290 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:07 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Volume volume-06a00a68-e351-48b1-a9ee-575b96e4696b (06a00a68-e351-48b1-a9ee-575b96e4696b): created successfully Jul 10 00:47:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de650a3-6ebc-4630-bf09-4b91ed95723c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:07 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Flow 'volume_create_manager' (3f9d9b01-8e8c-4ccb-9d15-f868e635b014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:07 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-2138a599-867e-4650-b01a-760cb769fc1f tempest-SnapshotDependencyTests-390917841 None] Created volume successfully. Jul 10 00:47:07 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f Jul 10 00:47:07 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-49ba7c98-cbec-4326-834c-40e48d78a04c tempest-SnapshotDependencyTests-390917841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:07 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-72aff970-9da9-4a2b-9e3e-82843bb6e54c tempest-VolumeDependencyTests-1531226867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de" returned: 0 in 0.892s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-72aff970-9da9-4a2b-9e3e-82843bb6e54c tempest-VolumeDependencyTests-1531226867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:07 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de Jul 10 00:47:07 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:07 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b2f17b67-8be5-44c5-8adb-49293d7a21fb tempest-ProjectReaderTests-1052592944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.875s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:07 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-b2f17b67-8be5-44c5-8adb-49293d7a21fb tempest-ProjectReaderTests-1052592944 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:47:07 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-b2f17b67-8be5-44c5-8adb-49293d7a21fb tempest-ProjectReaderTests-1052592944 None] Deleted volume successfully. Jul 10 00:47:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-b2f17b67-8be5-44c5-8adb-49293d7a21fb tempest-ProjectReaderTests-1052592944 None] Lock "cinder-09fecbf7-4eee-479e-a4f4-1fa83722ec83-delete_volume" released by "delete_volume" :: held 2.756s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:08 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c611a257-938e-4eea-a311-a932e0886290 tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f" returned: 0 in 0.998s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c611a257-938e-4eea-a311-a932e0886290 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:08 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99 1G Jul 10 00:47:08 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:08 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-72aff970-9da9-4a2b-9e3e-82843bb6e54c tempest-VolumeDependencyTests-1531226867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-db11a356-aec3-49b8-92f6-7241e7a614de" returned: 0 in 0.705s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-72aff970-9da9-4a2b-9e3e-82843bb6e54c tempest-VolumeDependencyTests-1531226867 None] Lock "cinder-quobyte-db11a356-aec3-49b8-92f6-7241e7a614de" released by "delete_volume" :: held 1.672s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:08 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-72aff970-9da9-4a2b-9e3e-82843bb6e54c tempest-VolumeDependencyTests-1531226867 None] Created reservations ['77adea1d-e95d-4d76-ad9b-56902b382e7d', '4c31311f-88c7-4a7e-b514-53949aa01c65', '6f9e4838-6fd2-48cf-a083-4d3ead07ecca', '35d10ef5-1037-4980-acaa-555737b0f110'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:47:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-72aff970-9da9-4a2b-9e3e-82843bb6e54c tempest-VolumeDependencyTests-1531226867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-72aff970-9da9-4a2b-9e3e-82843bb6e54c tempest-VolumeDependencyTests-1531226867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-72aff970-9da9-4a2b-9e3e-82843bb6e54c tempest-VolumeDependencyTests-1531226867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-72aff970-9da9-4a2b-9e3e-82843bb6e54c tempest-VolumeDependencyTests-1531226867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-72aff970-9da9-4a2b-9e3e-82843bb6e54c tempest-VolumeDependencyTests-1531226867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-72aff970-9da9-4a2b-9e3e-82843bb6e54c tempest-VolumeDependencyTests-1531226867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:08 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:47:08 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:09 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c611a257-938e-4eea-a311-a932e0886290 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99 1G" returned: 0 in 0.885s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c611a257-938e-4eea-a311-a932e0886290 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:09 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a8f48e82-22c4-4e9b-8adb-4990480ed426 tempest-VolumeDependencyTests-1531226867 None] Acquiring lock "cinder-2b7774de-455a-4727-a0ea-04e6ab8280da-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:09 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99 Jul 10 00:47:09 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:09 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a8f48e82-22c4-4e9b-8adb-4990480ed426 tempest-VolumeDependencyTests-1531226867 None] Lock "cinder-2b7774de-455a-4727-a0ea-04e6ab8280da-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:09 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a8f48e82-22c4-4e9b-8adb-4990480ed426 tempest-VolumeDependencyTests-1531226867 None] Acquiring lock "cinder-quobyte-2b7774de-455a-4727-a0ea-04e6ab8280da" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:09 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a8f48e82-22c4-4e9b-8adb-4990480ed426 tempest-VolumeDependencyTests-1531226867 None] Lock "cinder-quobyte-2b7774de-455a-4727-a0ea-04e6ab8280da" acquired by "delete_volume" :: waited 0.027s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:09 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[95550b4d-09b3-4e57-8c51-1270bd85107d]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a8f48e82-22c4-4e9b-8adb-4990480ed426 tempest-VolumeDependencyTests-1531226867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2b7774de-455a-4727-a0ea-04e6ab8280da {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:09 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2b7774de-455a-4727-a0ea-04e6ab8280da Jul 10 00:47:09 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:09 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-72aff970-9da9-4a2b-9e3e-82843bb6e54c tempest-VolumeDependencyTests-1531226867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.910s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:09 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-72aff970-9da9-4a2b-9e3e-82843bb6e54c tempest-VolumeDependencyTests-1531226867 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:47:09 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-72aff970-9da9-4a2b-9e3e-82843bb6e54c tempest-VolumeDependencyTests-1531226867 None] Deleted volume successfully. Jul 10 00:47:09 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-72aff970-9da9-4a2b-9e3e-82843bb6e54c tempest-VolumeDependencyTests-1531226867 None] Lock "cinder-db11a356-aec3-49b8-92f6-7241e7a614de-delete_volume" released by "delete_volume" :: held 2.861s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:09 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c611a257-938e-4eea-a311-a932e0886290 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99" returned: 0 in 0.828s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:09 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-c611a257-938e-4eea-a311-a932e0886290 tempest-ProjectMemberTests-1755578239 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99 is being set with open permissions: ugo+rw Jul 10 00:47:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c611a257-938e-4eea-a311-a932e0886290 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:09 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99 Jul 10 00:47:09 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:10 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a8f48e82-22c4-4e9b-8adb-4990480ed426 tempest-VolumeDependencyTests-1531226867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2b7774de-455a-4727-a0ea-04e6ab8280da" returned: 0 in 0.833s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a8f48e82-22c4-4e9b-8adb-4990480ed426 tempest-VolumeDependencyTests-1531226867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2b7774de-455a-4727-a0ea-04e6ab8280da {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:10 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2b7774de-455a-4727-a0ea-04e6ab8280da Jul 10 00:47:10 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:10 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c611a257-938e-4eea-a311-a932e0886290 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99" returned: 0 in 0.639s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c611a257-938e-4eea-a311-a932e0886290 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:10 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.info Jul 10 00:47:10 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:10 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a8f48e82-22c4-4e9b-8adb-4990480ed426 tempest-VolumeDependencyTests-1531226867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2b7774de-455a-4727-a0ea-04e6ab8280da" returned: 0 in 0.649s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:10 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a8f48e82-22c4-4e9b-8adb-4990480ed426 tempest-VolumeDependencyTests-1531226867 None] Lock "cinder-quobyte-2b7774de-455a-4727-a0ea-04e6ab8280da" released by "delete_volume" :: held 1.531s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:10 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-a8f48e82-22c4-4e9b-8adb-4990480ed426 tempest-VolumeDependencyTests-1531226867 None] Created reservations ['faf00cf6-dbc7-4af3-bf74-3d7b46c59058', '0e9750ea-20ed-4118-8ae7-55f6f05a2ce7', '06f11987-eec7-4927-9e6c-8b96ee374171', '7e4b236e-a1f0-4f3a-81ea-cca269362da9'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:47:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a8f48e82-22c4-4e9b-8adb-4990480ed426 tempest-VolumeDependencyTests-1531226867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a8f48e82-22c4-4e9b-8adb-4990480ed426 tempest-VolumeDependencyTests-1531226867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:10 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a8f48e82-22c4-4e9b-8adb-4990480ed426 tempest-VolumeDependencyTests-1531226867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:10 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a8f48e82-22c4-4e9b-8adb-4990480ed426 tempest-VolumeDependencyTests-1531226867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a8f48e82-22c4-4e9b-8adb-4990480ed426 tempest-VolumeDependencyTests-1531226867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a8f48e82-22c4-4e9b-8adb-4990480ed426 tempest-VolumeDependencyTests-1531226867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:10 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:47:10 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:11 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c611a257-938e-4eea-a311-a932e0886290 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.info" returned: 0 in 0.632s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:11 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-c611a257-938e-4eea-a311-a932e0886290 tempest-ProjectMemberTests-1755578239 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.info is being set with open permissions: ugo+rw Jul 10 00:47:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c611a257-938e-4eea-a311-a932e0886290 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:11 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.info Jul 10 00:47:11 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:11 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a8f48e82-22c4-4e9b-8adb-4990480ed426 tempest-VolumeDependencyTests-1531226867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.647s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:11 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-a8f48e82-22c4-4e9b-8adb-4990480ed426 tempest-VolumeDependencyTests-1531226867 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:47:11 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-a8f48e82-22c4-4e9b-8adb-4990480ed426 tempest-VolumeDependencyTests-1531226867 None] Deleted volume successfully. Jul 10 00:47:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a8f48e82-22c4-4e9b-8adb-4990480ed426 tempest-VolumeDependencyTests-1531226867 None] Lock "cinder-2b7774de-455a-4727-a0ea-04e6ab8280da-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:11 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c611a257-938e-4eea-a311-a932e0886290 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.info" returned: 0 in 0.692s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c611a257-938e-4eea-a311-a932e0886290 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.786s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-49ba7c98-cbec-4326-834c-40e48d78a04c tempest-SnapshotDependencyTests-390917841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.232s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:11 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-49ba7c98-cbec-4326-834c-40e48d78a04c tempest-SnapshotDependencyTests-390917841 None] Creating offline snapshot 02273e91-cbd3-4041-b0f5-215047ae9f8f of volume 06a00a68-e351-48b1-a9ee-575b96e4696b {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:47:11 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-c611a257-938e-4eea-a311-a932e0886290 tempest-ProjectMemberTests-1755578239 None] Create snapshot completed successfully Jul 10 00:47:11 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4dc1aa-45db-4730-b5bf-a0dec3f3231c]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-49ba7c98-cbec-4326-834c-40e48d78a04c tempest-SnapshotDependencyTests-390917841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:12 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b Jul 10 00:47:12 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:12 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-49ba7c98-cbec-4326-834c-40e48d78a04c tempest-SnapshotDependencyTests-390917841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b" returned: 0 in 0.860s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-49ba7c98-cbec-4326-834c-40e48d78a04c tempest-SnapshotDependencyTests-390917841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.02273e91-cbd3-4041-b0f5-215047ae9f8f 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:12 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.02273e91-cbd3-4041-b0f5-215047ae9f8f 1G Jul 10 00:47:12 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:12 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8f066e76-eb0b-4619-9f58-e29211213c8b tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:12 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8f066e76-eb0b-4619-9f58-e29211213c8b tempest-ProjectMemberTests-1755578239 None] Lock "cinder-8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:12 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8f066e76-eb0b-4619-9f58-e29211213c8b tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-34760940-ffc9-4e2c-a158-eb02b13bbc8f" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:13 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8f066e76-eb0b-4619-9f58-e29211213c8b tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-34760940-ffc9-4e2c-a158-eb02b13bbc8f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:13 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8f066e76-eb0b-4619-9f58-e29211213c8b tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:13 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8f066e76-eb0b-4619-9f58-e29211213c8b tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8f066e76-eb0b-4619-9f58-e29211213c8b tempest-ProjectMemberTests-1755578239 None] Deleting offline snapshot 8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99 of volume 34760940-ffc9-4e2c-a158-eb02b13bbc8f {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:47:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8f066e76-eb0b-4619-9f58-e29211213c8b tempest-ProjectMemberTests-1755578239 None] snapshot_file for this snap is: volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:47:13 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[13db7e4c-fe10-4266-a630-90fef300b80b]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8f066e76-eb0b-4619-9f58-e29211213c8b tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:13 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99 Jul 10 00:47:13 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:13 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-49ba7c98-cbec-4326-834c-40e48d78a04c tempest-SnapshotDependencyTests-390917841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.02273e91-cbd3-4041-b0f5-215047ae9f8f 1G" returned: 0 in 0.871s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-49ba7c98-cbec-4326-834c-40e48d78a04c tempest-SnapshotDependencyTests-390917841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a00a68-e351-48b1-a9ee-575b96e4696b -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.02273e91-cbd3-4041-b0f5-215047ae9f8f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:13 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a00a68-e351-48b1-a9ee-575b96e4696b -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.02273e91-cbd3-4041-b0f5-215047ae9f8f Jul 10 00:47:13 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:13 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8f066e76-eb0b-4619-9f58-e29211213c8b tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99" returned: 0 in 0.799s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8f066e76-eb0b-4619-9f58-e29211213c8b tempest-ProjectMemberTests-1755578239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:47:13 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0c91da-4a7d-4409-a0f5-079ba0997a3c]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8f066e76-eb0b-4619-9f58-e29211213c8b tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:14 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f Jul 10 00:47:14 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:14 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-49ba7c98-cbec-4326-834c-40e48d78a04c tempest-SnapshotDependencyTests-390917841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a00a68-e351-48b1-a9ee-575b96e4696b -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.02273e91-cbd3-4041-b0f5-215047ae9f8f" returned: 0 in 0.768s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:14 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-49ba7c98-cbec-4326-834c-40e48d78a04c tempest-SnapshotDependencyTests-390917841 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.02273e91-cbd3-4041-b0f5-215047ae9f8f is being set with open permissions: ugo+rw Jul 10 00:47:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-49ba7c98-cbec-4326-834c-40e48d78a04c tempest-SnapshotDependencyTests-390917841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.02273e91-cbd3-4041-b0f5-215047ae9f8f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:14 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.02273e91-cbd3-4041-b0f5-215047ae9f8f Jul 10 00:47:14 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:14 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8f066e76-eb0b-4619-9f58-e29211213c8b tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f" returned: 0 in 0.784s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8f066e76-eb0b-4619-9f58-e29211213c8b tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:14 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99 Jul 10 00:47:14 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:15 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-49ba7c98-cbec-4326-834c-40e48d78a04c tempest-SnapshotDependencyTests-390917841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.02273e91-cbd3-4041-b0f5-215047ae9f8f" returned: 0 in 0.750s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:15 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:47:15 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Flow 'volume_create_manager' (90e6792f-810d-4e77-9219-980b5d937c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:15 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c68a957-95c8-4c25-b490-19b857cb3117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:15 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c68a957-95c8-4c25-b490-19b857cb3117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1817760017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f3df44-1f86-4a6c-ac5f-b3732441870d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ea29ee052f4b8aac142f6ce2eb3d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:15Z,use_quota=True,user_id='9c4f444d003740afbc235bc3741be420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:15 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76551550-5842-4bc1-b9f8-163dab7f0686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:15 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76551550-5842-4bc1-b9f8-163dab7f0686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:15 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f09371-b0a5-4ec6-9ee2-49ca9dc30629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:15 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f09371-b0a5-4ec6-9ee2-49ca9dc30629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3f3df44-1f86-4a6c-ac5f-b3732441870d', 'volume_name': 'volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:15 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7ea12b9-8a71-4396-814e-835e6e813272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:15 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7ea12b9-8a71-4396-814e-835e6e813272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:15 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78639486-ec6c-4a94-9090-02d3d75390b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:15 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Volume c3f3df44-1f86-4a6c-ac5f-b3732441870d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d', 'volume_size': 1} Jul 10 00:47:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-49ba7c98-cbec-4326-834c-40e48d78a04c tempest-SnapshotDependencyTests-390917841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:15 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.info Jul 10 00:47:15 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:15 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8f066e76-eb0b-4619-9f58-e29211213c8b tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99" returned: 0 in 0.792s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8f066e76-eb0b-4619-9f58-e29211213c8b tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:15 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99 Jul 10 00:47:15 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:15 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-49ba7c98-cbec-4326-834c-40e48d78a04c tempest-SnapshotDependencyTests-390917841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.info" returned: 0 in 0.654s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:15 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-49ba7c98-cbec-4326-834c-40e48d78a04c tempest-SnapshotDependencyTests-390917841 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.info is being set with open permissions: ugo+rw Jul 10 00:47:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-49ba7c98-cbec-4326-834c-40e48d78a04c tempest-SnapshotDependencyTests-390917841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:16 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.info Jul 10 00:47:16 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:16 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8f066e76-eb0b-4619-9f58-e29211213c8b tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f.8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99" returned: 0 in 0.682s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:16 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8f066e76-eb0b-4619-9f58-e29211213c8b tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99" released by "_delete_snapshot" :: held 3.177s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:16 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8f066e76-eb0b-4619-9f58-e29211213c8b tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-34760940-ffc9-4e2c-a158-eb02b13bbc8f" released by "delete_snapshot" :: held 3.203s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:16 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-8f066e76-eb0b-4619-9f58-e29211213c8b tempest-ProjectMemberTests-1755578239 None] Created reservations ['acbe448d-0e99-43f2-9f9d-7a96fdd75c16', '1a9d1fc1-8fc7-4ec9-9a26-5548d9d98bf9', '0aeffc4d-670a-4b9f-98fc-9f3018040033', '7a94af6a-0c27-4615-8005-fb8bf6e09ae4'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:47:16 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-8f066e76-eb0b-4619-9f58-e29211213c8b tempest-ProjectMemberTests-1755578239 None] Delete snapshot completed successfully. Jul 10 00:47:16 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8f066e76-eb0b-4619-9f58-e29211213c8b tempest-ProjectMemberTests-1755578239 None] Lock "cinder-8cc7eaab-c1ad-4ca5-a748-b63c7c5e7e99-delete_snapshot" released by "delete_snapshot" :: held 3.340s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:16 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-49ba7c98-cbec-4326-834c-40e48d78a04c tempest-SnapshotDependencyTests-390917841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.info" returned: 0 in 0.643s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-49ba7c98-cbec-4326-834c-40e48d78a04c tempest-SnapshotDependencyTests-390917841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.744s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.326s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:16 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1817760017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f3df44-1f86-4a6c-ac5f-b3732441870d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ea29ee052f4b8aac142f6ce2eb3d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:15Z,use_quota=True,user_id='9c4f444d003740afbc235bc3741be420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:47:16 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Creating volume c3f3df44-1f86-4a6c-ac5f-b3732441870d {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:47:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:16 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:16 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:16 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:47:16 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:47:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:16 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d 1073741824 Jul 10 00:47:16 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:16 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-49ba7c98-cbec-4326-834c-40e48d78a04c tempest-SnapshotDependencyTests-390917841 None] Create snapshot completed successfully Jul 10 00:47:17 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-0120b0d7-f3e4-479f-938e-80aec4ff5cbe tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-34760940-ffc9-4e2c-a158-eb02b13bbc8f-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:17 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-0120b0d7-f3e4-479f-938e-80aec4ff5cbe tempest-ProjectMemberTests-1755578239 None] Lock "cinder-34760940-ffc9-4e2c-a158-eb02b13bbc8f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:17 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-0120b0d7-f3e4-479f-938e-80aec4ff5cbe tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-34760940-ffc9-4e2c-a158-eb02b13bbc8f" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:17 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-0120b0d7-f3e4-479f-938e-80aec4ff5cbe tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-34760940-ffc9-4e2c-a158-eb02b13bbc8f" acquired by "delete_volume" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:17 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e32424-7786-49d1-967f-d61cec5d5a2a]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0120b0d7-f3e4-479f-938e-80aec4ff5cbe tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:17 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f Jul 10 00:47:17 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:17 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d 1073741824" returned: 0 in 0.944s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:17 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d Jul 10 00:47:17 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:17 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:47:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Flow 'volume_create_manager' (9ae86349-6a71-4682-b63e-29e8ebab3ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff5f7ec-daf9-4f4f-961c-c9609ac79a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff5f7ec-daf9-4f4f-961c-c9609ac79a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d8e6fb-436b-4135-aaa1-6287b7d08dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01399e7403db41c89fe94e8e30b1e6d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=02273e91-cbd3-4041-b0f5-215047ae9f8f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:18Z,use_quota=True,user_id='9867f2d3f143439384c7778b2b7ff966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae2cee3-ef1b-4792-9e75-2e4556b6857e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ae2cee3-ef1b-4792-9e75-2e4556b6857e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d7a76c-442e-4b50-9e68-ff976d490aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d7a76c-442e-4b50-9e68-ff976d490aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '27d8e6fb-436b-4135-aaa1-6287b7d08dd4', 'volume_name': 'volume-27d8e6fb-436b-4135-aaa1-6287b7d08dd4', 'volume_size': 1, 'snapshot_id': '02273e91-cbd3-4041-b0f5-215047ae9f8f'}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7110c1-aee6-46e3-9b5e-7456cd8cd5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7110c1-aee6-46e3-9b5e-7456cd8cd5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:17 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789f1334-74d5-4e15-982f-0d2624bb59e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:17 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Volume 27d8e6fb-436b-4135-aaa1-6287b7d08dd4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-27d8e6fb-436b-4135-aaa1-6287b7d08dd4', 'volume_size': 1, 'snapshot_id': '02273e91-cbd3-4041-b0f5-215047ae9f8f'} Jul 10 00:47:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:18 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0120b0d7-f3e4-479f-938e-80aec4ff5cbe tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f" returned: 0 in 0.780s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0120b0d7-f3e4-479f-938e-80aec4ff5cbe tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:18 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f Jul 10 00:47:18 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:18 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d" returned: 0 in 0.706s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.535s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Acquiring lock "cinder-quobyte-02273e91-cbd3-4041-b0f5-215047ae9f8f-27d8e6fb-436b-4135-aaa1-6287b7d08dd4" by "_create_volume_from_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78639486-ec6c-4a94-9090-02d3d75390b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8bb900f-c738-4606-b580-a2437297183d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Lock "cinder-quobyte-02273e91-cbd3-4041-b0f5-215047ae9f8f-27d8e6fb-436b-4135-aaa1-6287b7d08dd4" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Creating volume 27d8e6fb-436b-4135-aaa1-6287b7d08dd4 from snapshot 02273e91-cbd3-4041-b0f5-215047ae9f8f {{(pid=88119) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Acquiring lock "cinder-quobyte-27d8e6fb-436b-4135-aaa1-6287b7d08dd4" by "_copy_volume_from_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:18 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Volume volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d (c3f3df44-1f86-4a6c-ac5f-b3732441870d): created successfully Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8bb900f-c738-4606-b580-a2437297183d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Flow 'volume_create_manager' (90e6792f-810d-4e77-9219-980b5d937c7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Lock "cinder-quobyte-27d8e6fb-436b-4135-aaa1-6287b7d08dd4" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] snapshot: 02273e91-cbd3-4041-b0f5-215047ae9f8f, volume: 27d8e6fb-436b-4135-aaa1-6287b7d08dd4, {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 00:47:18 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-6911637e-1e06-4c6f-a2ff-2f8c6f44e7e4 tempest-ProjectReaderTests-619335768 None] Created volume successfully. Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f5ec46-e517-4ff4-a14c-2e561bf7ae49]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.02273e91-cbd3-4041-b0f5-215047ae9f8f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:18 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.02273e91-cbd3-4041-b0f5-215047ae9f8f Jul 10 00:47:18 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:18 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0120b0d7-f3e4-479f-938e-80aec4ff5cbe tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-34760940-ffc9-4e2c-a158-eb02b13bbc8f" returned: 0 in 0.677s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-0120b0d7-f3e4-479f-938e-80aec4ff5cbe tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-34760940-ffc9-4e2c-a158-eb02b13bbc8f" released by "delete_volume" :: held 1.521s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:18 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-0120b0d7-f3e4-479f-938e-80aec4ff5cbe tempest-ProjectMemberTests-1755578239 None] Created reservations ['032014e4-867f-4c4d-bf56-bbb150e31ce7', '667d0770-8770-40d3-908f-f805de692d42', '16346cdc-63f9-4dec-8a71-021aab49603b', '5d495f85-fe9f-4c6e-8414-36a9338c215f'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:47:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0120b0d7-f3e4-479f-938e-80aec4ff5cbe tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0120b0d7-f3e4-479f-938e-80aec4ff5cbe tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0120b0d7-f3e4-479f-938e-80aec4ff5cbe tempest-ProjectMemberTests-1755578239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0120b0d7-f3e4-479f-938e-80aec4ff5cbe tempest-ProjectMemberTests-1755578239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0120b0d7-f3e4-479f-938e-80aec4ff5cbe tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0120b0d7-f3e4-479f-938e-80aec4ff5cbe tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:19 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:47:19 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:19 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.02273e91-cbd3-4041-b0f5-215047ae9f8f" returned: 0 in 0.754s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06a00a68-e351-48b1-a9ee-575b96e4696b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:47:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 00:47:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Creating direct copy from snapshot {{(pid=88119) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 00:47:19 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9dde9b-8363-4437-ad52-c151de97fe33]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:19 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b Jul 10 00:47:19 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:19 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=132,cinder:INSERT=45,cinder:UPDATE=164,cinder:DELETE=14 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:47:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-eb590a43-3f8b-44b3-bc96-debb3c03a7fc tempest-ProjectReaderTests-619335768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:19 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0120b0d7-f3e4-479f-938e-80aec4ff5cbe tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.765s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:19 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-0120b0d7-f3e4-479f-938e-80aec4ff5cbe tempest-ProjectMemberTests-1755578239 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:47:19 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-0120b0d7-f3e4-479f-938e-80aec4ff5cbe tempest-ProjectMemberTests-1755578239 None] Deleted volume successfully. Jul 10 00:47:19 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-0120b0d7-f3e4-479f-938e-80aec4ff5cbe tempest-ProjectMemberTests-1755578239 None] Lock "cinder-34760940-ffc9-4e2c-a158-eb02b13bbc8f-delete_volume" released by "delete_volume" :: held 2.502s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:20 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b" returned: 0 in 0.872s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:20 devstack cinder-volume[88119]: DEBUG cinder.utils [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Path /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-27d8e6fb-436b-4135-aaa1-6287b7d08dd4 not found in is_blk_device check {{(pid=88119) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 00:47:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-27d8e6fb-436b-4135-aaa1-6287b7d08dd4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:20 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-27d8e6fb-436b-4135-aaa1-6287b7d08dd4 Jul 10 00:47:20 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:20 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:47:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Flow 'volume_create_manager' (a9a661f2-8b26-475e-82e3-8c00462d40db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0e45b5c-e996-477e-961e-10f93f2a53cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0e45b5c-e996-477e-961e-10f93f2a53cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1747017617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0142605-c123-4dd5-b72f-559d47f957f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f238e094d83c41769907fe7fe98cb92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:20Z,use_quota=True,user_id='6ae3ebc77379400a81756522642f35cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370acf47-7b34-4572-8ff7-fd875c276931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370acf47-7b34-4572-8ff7-fd875c276931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac33ecbe-8978-4c4d-8092-23a8a02dcd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac33ecbe-8978-4c4d-8092-23a8a02dcd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0142605-c123-4dd5-b72f-559d47f957f2', 'volume_name': 'volume-b0142605-c123-4dd5-b72f-559d47f957f2', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab69c75-77cb-49eb-bfa9-f32257057fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab69c75-77cb-49eb-bfa9-f32257057fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cbe0b65-0b3d-4f01-9820-aad81afd0081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:20 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Volume b0142605-c123-4dd5-b72f-559d47f957f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0142605-c123-4dd5-b72f-559d47f957f2', 'volume_size': 1} Jul 10 00:47:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:24 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-27d8e6fb-436b-4135-aaa1-6287b7d08dd4" returned: 0 in 4.246s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:24 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8552871-be5c-4b25-85cc-8cbcee69dfe3]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:24 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b Jul 10 00:47:24 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:25 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b" returned: 0 in 0.926s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:25 devstack cinder-volume[88119]: DEBUG cinder.image.image_utils [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Image conversion details: src /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b, size 1024.00 MB, duration 4.25 sec, destination /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-27d8e6fb-436b-4135-aaa1-6287b7d08dd4 {{(pid=88119) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 00:47:25 devstack cinder-volume[88119]: INFO cinder.image.image_utils [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Converted 1024.00 MB image at 241.09 MB/s Jul 10 00:47:25 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-27d8e6fb-436b-4135-aaa1-6287b7d08dd4 is being set with open permissions: ugo+rw Jul 10 00:47:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-27d8e6fb-436b-4135-aaa1-6287b7d08dd4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:25 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-27d8e6fb-436b-4135-aaa1-6287b7d08dd4 Jul 10 00:47:25 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:25 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-27d8e6fb-436b-4135-aaa1-6287b7d08dd4" returned: 0 in 0.657s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Lock "cinder-quobyte-27d8e6fb-436b-4135-aaa1-6287b7d08dd4" released by "_copy_volume_from_snapshot" :: held 7.577s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Lock "cinder-quobyte-02273e91-cbd3-4041-b0f5-215047ae9f8f-27d8e6fb-436b-4135-aaa1-6287b7d08dd4" released by "_create_volume_from_snapshot" :: held 7.626s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.662s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-eb590a43-3f8b-44b3-bc96-debb3c03a7fc tempest-ProjectReaderTests-619335768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.253s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-eb590a43-3f8b-44b3-bc96-debb3c03a7fc tempest-ProjectReaderTests-619335768 None] Creating offline snapshot 31476bd4-8eee-408a-a2f2-0e169d3257e2 of volume c3f3df44-1f86-4a6c-ac5f-b3732441870d {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:47:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789f1334-74d5-4e15-982f-0d2624bb59e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27d8e6fb-436b-4135-aaa1-6287b7d08dd4', 'volume_size': 1, 'snapshot_id': '02273e91-cbd3-4041-b0f5-215047ae9f8f'}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94b37638-6a4b-4e81-9e4c-cb2e21f2e8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:26 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e060e110-cf8a-4d96-9b12-6c22ce20df8e]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eb590a43-3f8b-44b3-bc96-debb3c03a7fc tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:26 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Volume volume-27d8e6fb-436b-4135-aaa1-6287b7d08dd4 (27d8e6fb-436b-4135-aaa1-6287b7d08dd4): created successfully Jul 10 00:47:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94b37638-6a4b-4e81-9e4c-cb2e21f2e8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:26 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Flow 'volume_create_manager' (9ae86349-6a71-4682-b63e-29e8ebab3ef1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:26 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-f17effd3-ab94-4258-9401-ae5903977b76 tempest-SnapshotDependencyTests-390917841 None] Created volume successfully. Jul 10 00:47:26 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d Jul 10 00:47:26 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-96399209-1208-4a50-bcf8-8cc6be31b2cb tempest-SnapshotDependencyTests-390917841 None] Acquiring lock "cinder-02273e91-cbd3-4041-b0f5-215047ae9f8f-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-96399209-1208-4a50-bcf8-8cc6be31b2cb tempest-SnapshotDependencyTests-390917841 None] Lock "cinder-02273e91-cbd3-4041-b0f5-215047ae9f8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-96399209-1208-4a50-bcf8-8cc6be31b2cb tempest-SnapshotDependencyTests-390917841 None] Acquiring lock "cinder-quobyte-06a00a68-e351-48b1-a9ee-575b96e4696b" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-96399209-1208-4a50-bcf8-8cc6be31b2cb tempest-SnapshotDependencyTests-390917841 None] Lock "cinder-quobyte-06a00a68-e351-48b1-a9ee-575b96e4696b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-96399209-1208-4a50-bcf8-8cc6be31b2cb tempest-SnapshotDependencyTests-390917841 None] Acquiring lock "cinder-quobyte-02273e91-cbd3-4041-b0f5-215047ae9f8f" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-96399209-1208-4a50-bcf8-8cc6be31b2cb tempest-SnapshotDependencyTests-390917841 None] Lock "cinder-quobyte-02273e91-cbd3-4041-b0f5-215047ae9f8f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-96399209-1208-4a50-bcf8-8cc6be31b2cb tempest-SnapshotDependencyTests-390917841 None] Deleting offline snapshot 02273e91-cbd3-4041-b0f5-215047ae9f8f of volume 06a00a68-e351-48b1-a9ee-575b96e4696b {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:47:26 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-96399209-1208-4a50-bcf8-8cc6be31b2cb tempest-SnapshotDependencyTests-390917841 None] snapshot_file for this snap is: volume-06a00a68-e351-48b1-a9ee-575b96e4696b.02273e91-cbd3-4041-b0f5-215047ae9f8f {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:47:26 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b9e365-d96e-4784-8bcd-39eabeb1740b]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-96399209-1208-4a50-bcf8-8cc6be31b2cb tempest-SnapshotDependencyTests-390917841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.02273e91-cbd3-4041-b0f5-215047ae9f8f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:26 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.02273e91-cbd3-4041-b0f5-215047ae9f8f Jul 10 00:47:26 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:26 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eb590a43-3f8b-44b3-bc96-debb3c03a7fc tempest-ProjectReaderTests-619335768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d" returned: 0 in 0.746s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eb590a43-3f8b-44b3-bc96-debb3c03a7fc tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.31476bd4-8eee-408a-a2f2-0e169d3257e2 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:26 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.31476bd4-8eee-408a-a2f2-0e169d3257e2 1G Jul 10 00:47:26 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:27 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-96399209-1208-4a50-bcf8-8cc6be31b2cb tempest-SnapshotDependencyTests-390917841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.02273e91-cbd3-4041-b0f5-215047ae9f8f" returned: 0 in 0.737s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:27 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-96399209-1208-4a50-bcf8-8cc6be31b2cb tempest-SnapshotDependencyTests-390917841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06a00a68-e351-48b1-a9ee-575b96e4696b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:47:27 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c650bb-c2f2-4a55-ad67-0f288f550d47]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-96399209-1208-4a50-bcf8-8cc6be31b2cb tempest-SnapshotDependencyTests-390917841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:27 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b Jul 10 00:47:27 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:27 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eb590a43-3f8b-44b3-bc96-debb3c03a7fc tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.31476bd4-8eee-408a-a2f2-0e169d3257e2 1G" returned: 0 in 0.811s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eb590a43-3f8b-44b3-bc96-debb3c03a7fc tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.31476bd4-8eee-408a-a2f2-0e169d3257e2 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:27 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.31476bd4-8eee-408a-a2f2-0e169d3257e2 Jul 10 00:47:27 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:28 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-96399209-1208-4a50-bcf8-8cc6be31b2cb tempest-SnapshotDependencyTests-390917841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b" returned: 0 in 0.770s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-96399209-1208-4a50-bcf8-8cc6be31b2cb tempest-SnapshotDependencyTests-390917841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.02273e91-cbd3-4041-b0f5-215047ae9f8f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:28 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.02273e91-cbd3-4041-b0f5-215047ae9f8f Jul 10 00:47:28 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:28 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eb590a43-3f8b-44b3-bc96-debb3c03a7fc tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.31476bd4-8eee-408a-a2f2-0e169d3257e2" returned: 0 in 0.675s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:28 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-eb590a43-3f8b-44b3-bc96-debb3c03a7fc tempest-ProjectReaderTests-619335768 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.31476bd4-8eee-408a-a2f2-0e169d3257e2 is being set with open permissions: ugo+rw Jul 10 00:47:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eb590a43-3f8b-44b3-bc96-debb3c03a7fc tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.31476bd4-8eee-408a-a2f2-0e169d3257e2 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:28 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.31476bd4-8eee-408a-a2f2-0e169d3257e2 Jul 10 00:47:28 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:28 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-96399209-1208-4a50-bcf8-8cc6be31b2cb tempest-SnapshotDependencyTests-390917841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.02273e91-cbd3-4041-b0f5-215047ae9f8f" returned: 0 in 0.739s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-96399209-1208-4a50-bcf8-8cc6be31b2cb tempest-SnapshotDependencyTests-390917841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.02273e91-cbd3-4041-b0f5-215047ae9f8f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:28 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.02273e91-cbd3-4041-b0f5-215047ae9f8f Jul 10 00:47:28 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:28 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eb590a43-3f8b-44b3-bc96-debb3c03a7fc tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.31476bd4-8eee-408a-a2f2-0e169d3257e2" returned: 0 in 0.605s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:28 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:UPDATE=156,cinder:SELECT=106,cinder:INSERT=36,cinder:DELETE=13 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:47:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eb590a43-3f8b-44b3-bc96-debb3c03a7fc tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:28 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.info Jul 10 00:47:28 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:29 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-96399209-1208-4a50-bcf8-8cc6be31b2cb tempest-SnapshotDependencyTests-390917841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b.02273e91-cbd3-4041-b0f5-215047ae9f8f" returned: 0 in 0.640s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:29 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-96399209-1208-4a50-bcf8-8cc6be31b2cb tempest-SnapshotDependencyTests-390917841 None] Lock "cinder-quobyte-02273e91-cbd3-4041-b0f5-215047ae9f8f" released by "_delete_snapshot" :: held 2.989s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:29 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-96399209-1208-4a50-bcf8-8cc6be31b2cb tempest-SnapshotDependencyTests-390917841 None] Lock "cinder-quobyte-06a00a68-e351-48b1-a9ee-575b96e4696b" released by "delete_snapshot" :: held 3.015s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:29 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eb590a43-3f8b-44b3-bc96-debb3c03a7fc tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.info" returned: 0 in 0.654s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:29 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-eb590a43-3f8b-44b3-bc96-debb3c03a7fc tempest-ProjectReaderTests-619335768 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.info is being set with open permissions: ugo+rw Jul 10 00:47:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eb590a43-3f8b-44b3-bc96-debb3c03a7fc tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:29 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.info Jul 10 00:47:29 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:29 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-96399209-1208-4a50-bcf8-8cc6be31b2cb tempest-SnapshotDependencyTests-390917841 None] Created reservations ['e53dc631-3d09-45f3-9a8f-d8fc9d929f94', 'e76ae6c4-2e55-46fb-b53f-f57ffdc9dffb', '5b4cada4-c780-47a2-ad3f-cc6657b93187', '736eabad-1433-44f1-8a09-6f577170e3f2'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:47:29 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-96399209-1208-4a50-bcf8-8cc6be31b2cb tempest-SnapshotDependencyTests-390917841 None] Delete snapshot completed successfully. Jul 10 00:47:29 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-96399209-1208-4a50-bcf8-8cc6be31b2cb tempest-SnapshotDependencyTests-390917841 None] Lock "cinder-02273e91-cbd3-4041-b0f5-215047ae9f8f-delete_snapshot" released by "delete_snapshot" :: held 3.172s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:30 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eb590a43-3f8b-44b3-bc96-debb3c03a7fc tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.info" returned: 0 in 0.639s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-eb590a43-3f8b-44b3-bc96-debb3c03a7fc tempest-ProjectReaderTests-619335768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.230s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.979s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:30 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1747017617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0142605-c123-4dd5-b72f-559d47f957f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f238e094d83c41769907fe7fe98cb92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:20Z,use_quota=True,user_id='6ae3ebc77379400a81756522642f35cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:47:30 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Creating volume b0142605-c123-4dd5-b72f-559d47f957f2 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:47:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:30 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:30 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:30 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:47:30 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:47:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:30 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2 1073741824 Jul 10 00:47:30 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:30 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-eb590a43-3f8b-44b3-bc96-debb3c03a7fc tempest-ProjectReaderTests-619335768 None] Create snapshot completed successfully Jul 10 00:47:30 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-aadd51e4-674b-4af6-a7f1-65deafe0f67e tempest-SnapshotDependencyTests-390917841 None] Acquiring lock "cinder-06a00a68-e351-48b1-a9ee-575b96e4696b-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:30 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-aadd51e4-674b-4af6-a7f1-65deafe0f67e tempest-SnapshotDependencyTests-390917841 None] Lock "cinder-06a00a68-e351-48b1-a9ee-575b96e4696b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:30 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-aadd51e4-674b-4af6-a7f1-65deafe0f67e tempest-SnapshotDependencyTests-390917841 None] Acquiring lock "cinder-quobyte-06a00a68-e351-48b1-a9ee-575b96e4696b" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:30 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-aadd51e4-674b-4af6-a7f1-65deafe0f67e tempest-SnapshotDependencyTests-390917841 None] Lock "cinder-quobyte-06a00a68-e351-48b1-a9ee-575b96e4696b" acquired by "delete_volume" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:30 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[9037ae66-8afa-46c9-8060-00ff66c07d6b]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-aadd51e4-674b-4af6-a7f1-65deafe0f67e tempest-SnapshotDependencyTests-390917841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:30 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b Jul 10 00:47:30 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:31 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2 1073741824" returned: 0 in 0.811s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:31 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2 Jul 10 00:47:31 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3ce27235-df7a-458a-ba31-e63694ec5cb4 tempest-ProjectReaderTests-619335768 None] Acquiring lock "cinder-31476bd4-8eee-408a-a2f2-0e169d3257e2-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3ce27235-df7a-458a-ba31-e63694ec5cb4 tempest-ProjectReaderTests-619335768 None] Lock "cinder-31476bd4-8eee-408a-a2f2-0e169d3257e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3ce27235-df7a-458a-ba31-e63694ec5cb4 tempest-ProjectReaderTests-619335768 None] Acquiring lock "cinder-quobyte-c3f3df44-1f86-4a6c-ac5f-b3732441870d" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3ce27235-df7a-458a-ba31-e63694ec5cb4 tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-c3f3df44-1f86-4a6c-ac5f-b3732441870d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3ce27235-df7a-458a-ba31-e63694ec5cb4 tempest-ProjectReaderTests-619335768 None] Acquiring lock "cinder-quobyte-31476bd4-8eee-408a-a2f2-0e169d3257e2" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3ce27235-df7a-458a-ba31-e63694ec5cb4 tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-31476bd4-8eee-408a-a2f2-0e169d3257e2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-3ce27235-df7a-458a-ba31-e63694ec5cb4 tempest-ProjectReaderTests-619335768 None] Deleting offline snapshot 31476bd4-8eee-408a-a2f2-0e169d3257e2 of volume c3f3df44-1f86-4a6c-ac5f-b3732441870d {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-3ce27235-df7a-458a-ba31-e63694ec5cb4 tempest-ProjectReaderTests-619335768 None] snapshot_file for this snap is: volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.31476bd4-8eee-408a-a2f2-0e169d3257e2 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f40893-7ac4-44ae-bde8-c27927008130]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3ce27235-df7a-458a-ba31-e63694ec5cb4 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.31476bd4-8eee-408a-a2f2-0e169d3257e2 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:31 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.31476bd4-8eee-408a-a2f2-0e169d3257e2 Jul 10 00:47:31 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:31 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-aadd51e4-674b-4af6-a7f1-65deafe0f67e tempest-SnapshotDependencyTests-390917841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b" returned: 0 in 0.804s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-aadd51e4-674b-4af6-a7f1-65deafe0f67e tempest-SnapshotDependencyTests-390917841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:31 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:47:31 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:31 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b Jul 10 00:47:31 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:31 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2" returned: 0 in 0.676s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cbe0b65-0b3d-4f01-9820-aad81afd0081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0142605-c123-4dd5-b72f-559d47f957f2', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62de2f29-78e9-49d4-b9fe-9243e5573c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:31 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Volume volume-b0142605-c123-4dd5-b72f-559d47f957f2 (b0142605-c123-4dd5-b72f-559d47f957f2): created successfully Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62de2f29-78e9-49d4-b9fe-9243e5573c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:31 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Flow 'volume_create_manager' (a9a661f2-8b26-475e-82e3-8c00462d40db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:31 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-e42fab83-d515-48c5-8a3e-97f552d7136f tempest-ProjectMemberTests-1755578239 None] Created volume successfully. Jul 10 00:47:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-cbaa009b-3fb0-4b4e-bea7-a086e6a5a157 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-cbaa009b-3fb0-4b4e-bea7-a086e6a5a157 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-cbaa009b-3fb0-4b4e-bea7-a086e6a5a157 tempest-ProjectMemberTests-1755578239 None] Creating offline snapshot e5afbb09-2bc0-42f9-be30-6386c7d36f51 of volume b0142605-c123-4dd5-b72f-559d47f957f2 {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:47:32 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f18ef3-1129-4cb1-b916-d49958771c3a]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cbaa009b-3fb0-4b4e-bea7-a086e6a5a157 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:32 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2 Jul 10 00:47:32 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:32 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3ce27235-df7a-458a-ba31-e63694ec5cb4 tempest-ProjectReaderTests-619335768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.31476bd4-8eee-408a-a2f2-0e169d3257e2" returned: 0 in 0.844s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-3ce27235-df7a-458a-ba31-e63694ec5cb4 tempest-ProjectReaderTests-619335768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:47:32 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d154157-a947-4fda-b65c-5fb6b9cd9ca3]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3ce27235-df7a-458a-ba31-e63694ec5cb4 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:32 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.740s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:32 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:47:32 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:47:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 29 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:47:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:47:32 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d Jul 10 00:47:32 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:32 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-aadd51e4-674b-4af6-a7f1-65deafe0f67e tempest-SnapshotDependencyTests-390917841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-06a00a68-e351-48b1-a9ee-575b96e4696b" returned: 0 in 0.879s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-aadd51e4-674b-4af6-a7f1-65deafe0f67e tempest-SnapshotDependencyTests-390917841 None] Lock "cinder-quobyte-06a00a68-e351-48b1-a9ee-575b96e4696b" released by "delete_volume" :: held 1.755s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:32 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-aadd51e4-674b-4af6-a7f1-65deafe0f67e tempest-SnapshotDependencyTests-390917841 None] Created reservations ['fcc2c793-bd80-41d5-abe4-73ff5d6d1ba0', 'bb94a01a-afca-4c82-9ec1-5a59c2ed6f0f', '572404c0-e26e-41e8-a255-57311902ade9', 'ee996dc3-2569-4cd6-9394-14dc8507dcea'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:47:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-aadd51e4-674b-4af6-a7f1-65deafe0f67e tempest-SnapshotDependencyTests-390917841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-aadd51e4-674b-4af6-a7f1-65deafe0f67e tempest-SnapshotDependencyTests-390917841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-aadd51e4-674b-4af6-a7f1-65deafe0f67e tempest-SnapshotDependencyTests-390917841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:32 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-aadd51e4-674b-4af6-a7f1-65deafe0f67e tempest-SnapshotDependencyTests-390917841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-aadd51e4-674b-4af6-a7f1-65deafe0f67e tempest-SnapshotDependencyTests-390917841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-aadd51e4-674b-4af6-a7f1-65deafe0f67e tempest-SnapshotDependencyTests-390917841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:32 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:47:32 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:33 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cbaa009b-3fb0-4b4e-bea7-a086e6a5a157 tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2" returned: 0 in 0.816s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cbaa009b-3fb0-4b4e-bea7-a086e6a5a157 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2.e5afbb09-2bc0-42f9-be30-6386c7d36f51 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:33 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2.e5afbb09-2bc0-42f9-be30-6386c7d36f51 1G Jul 10 00:47:33 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-80a31176-439c-4db4-b96b-d70ad46f4b4c tempest-SnapshotDependencyTests-390917841 None] Acquiring lock "cinder-27d8e6fb-436b-4135-aaa1-6287b7d08dd4-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:33 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:33 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-80a31176-439c-4db4-b96b-d70ad46f4b4c tempest-SnapshotDependencyTests-390917841 None] Lock "cinder-27d8e6fb-436b-4135-aaa1-6287b7d08dd4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:33 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-80a31176-439c-4db4-b96b-d70ad46f4b4c tempest-SnapshotDependencyTests-390917841 None] Acquiring lock "cinder-quobyte-27d8e6fb-436b-4135-aaa1-6287b7d08dd4" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:33 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-80a31176-439c-4db4-b96b-d70ad46f4b4c tempest-SnapshotDependencyTests-390917841 None] Lock "cinder-quobyte-27d8e6fb-436b-4135-aaa1-6287b7d08dd4" acquired by "delete_volume" :: waited 0.014s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:33 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec44637c-95aa-4f38-9556-cc80f18afa00]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-80a31176-439c-4db4-b96b-d70ad46f4b4c tempest-SnapshotDependencyTests-390917841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-27d8e6fb-436b-4135-aaa1-6287b7d08dd4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:33 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3ce27235-df7a-458a-ba31-e63694ec5cb4 tempest-ProjectReaderTests-619335768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d" returned: 0 in 0.896s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3ce27235-df7a-458a-ba31-e63694ec5cb4 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.31476bd4-8eee-408a-a2f2-0e169d3257e2 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:33 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.31476bd4-8eee-408a-a2f2-0e169d3257e2 Jul 10 00:47:33 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:33 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-27d8e6fb-436b-4135-aaa1-6287b7d08dd4 Jul 10 00:47:33 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:33 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-aadd51e4-674b-4af6-a7f1-65deafe0f67e tempest-SnapshotDependencyTests-390917841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.708s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:33 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-aadd51e4-674b-4af6-a7f1-65deafe0f67e tempest-SnapshotDependencyTests-390917841 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:47:33 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-aadd51e4-674b-4af6-a7f1-65deafe0f67e tempest-SnapshotDependencyTests-390917841 None] Deleted volume successfully. Jul 10 00:47:33 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-aadd51e4-674b-4af6-a7f1-65deafe0f67e tempest-SnapshotDependencyTests-390917841 None] Lock "cinder-06a00a68-e351-48b1-a9ee-575b96e4696b-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:33 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cbaa009b-3fb0-4b4e-bea7-a086e6a5a157 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2.e5afbb09-2bc0-42f9-be30-6386c7d36f51 1G" returned: 0 in 0.879s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cbaa009b-3fb0-4b4e-bea7-a086e6a5a157 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0142605-c123-4dd5-b72f-559d47f957f2 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2.e5afbb09-2bc0-42f9-be30-6386c7d36f51 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:33 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0142605-c123-4dd5-b72f-559d47f957f2 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2.e5afbb09-2bc0-42f9-be30-6386c7d36f51 Jul 10 00:47:33 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:34 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-80a31176-439c-4db4-b96b-d70ad46f4b4c tempest-SnapshotDependencyTests-390917841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-27d8e6fb-436b-4135-aaa1-6287b7d08dd4" returned: 0 in 0.825s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-80a31176-439c-4db4-b96b-d70ad46f4b4c tempest-SnapshotDependencyTests-390917841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-27d8e6fb-436b-4135-aaa1-6287b7d08dd4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:34 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-27d8e6fb-436b-4135-aaa1-6287b7d08dd4 Jul 10 00:47:34 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:34 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3ce27235-df7a-458a-ba31-e63694ec5cb4 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.31476bd4-8eee-408a-a2f2-0e169d3257e2" returned: 0 in 0.806s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3ce27235-df7a-458a-ba31-e63694ec5cb4 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.31476bd4-8eee-408a-a2f2-0e169d3257e2 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:34 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.31476bd4-8eee-408a-a2f2-0e169d3257e2 Jul 10 00:47:34 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:34 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cbaa009b-3fb0-4b4e-bea7-a086e6a5a157 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0142605-c123-4dd5-b72f-559d47f957f2 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2.e5afbb09-2bc0-42f9-be30-6386c7d36f51" returned: 0 in 0.721s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:34 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-cbaa009b-3fb0-4b4e-bea7-a086e6a5a157 tempest-ProjectMemberTests-1755578239 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2.e5afbb09-2bc0-42f9-be30-6386c7d36f51 is being set with open permissions: ugo+rw Jul 10 00:47:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cbaa009b-3fb0-4b4e-bea7-a086e6a5a157 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2.e5afbb09-2bc0-42f9-be30-6386c7d36f51 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:34 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2.e5afbb09-2bc0-42f9-be30-6386c7d36f51 Jul 10 00:47:34 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:34 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-80a31176-439c-4db4-b96b-d70ad46f4b4c tempest-SnapshotDependencyTests-390917841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-27d8e6fb-436b-4135-aaa1-6287b7d08dd4" returned: 0 in 0.680s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:34 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-80a31176-439c-4db4-b96b-d70ad46f4b4c tempest-SnapshotDependencyTests-390917841 None] Lock "cinder-quobyte-27d8e6fb-436b-4135-aaa1-6287b7d08dd4" released by "delete_volume" :: held 1.552s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:34 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-80a31176-439c-4db4-b96b-d70ad46f4b4c tempest-SnapshotDependencyTests-390917841 None] Created reservations ['11079cfa-3083-4c95-a139-96f791ef8db3', 'fc994d48-fa3f-45ba-baff-cb1a6fa123a4', '9efdda33-5e34-4ce6-91fe-c16504b7732a', '97aab32b-94f4-409e-b33c-243f44a6f761'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:47:34 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3ce27235-df7a-458a-ba31-e63694ec5cb4 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d.31476bd4-8eee-408a-a2f2-0e169d3257e2" returned: 0 in 0.733s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:34 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3ce27235-df7a-458a-ba31-e63694ec5cb4 tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-31476bd4-8eee-408a-a2f2-0e169d3257e2" released by "_delete_snapshot" :: held 3.381s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:34 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3ce27235-df7a-458a-ba31-e63694ec5cb4 tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-c3f3df44-1f86-4a6c-ac5f-b3732441870d" released by "delete_snapshot" :: held 3.407s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-80a31176-439c-4db4-b96b-d70ad46f4b4c tempest-SnapshotDependencyTests-390917841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-80a31176-439c-4db4-b96b-d70ad46f4b4c tempest-SnapshotDependencyTests-390917841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-80a31176-439c-4db4-b96b-d70ad46f4b4c tempest-SnapshotDependencyTests-390917841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-80a31176-439c-4db4-b96b-d70ad46f4b4c tempest-SnapshotDependencyTests-390917841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-80a31176-439c-4db4-b96b-d70ad46f4b4c tempest-SnapshotDependencyTests-390917841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-80a31176-439c-4db4-b96b-d70ad46f4b4c tempest-SnapshotDependencyTests-390917841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:34 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:47:34 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:34 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-3ce27235-df7a-458a-ba31-e63694ec5cb4 tempest-ProjectReaderTests-619335768 None] Created reservations ['8c7fb489-a5df-478f-8ba1-8df86c31a277', '298eb8f7-7505-4121-9333-85c6e680a3a6', 'c36e9d05-2d73-4f5d-9505-59ee3b639a53', '2770d62e-53d4-45cc-a465-e1ff6ccf637c'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:47:35 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-3ce27235-df7a-458a-ba31-e63694ec5cb4 tempest-ProjectReaderTests-619335768 None] Delete snapshot completed successfully. Jul 10 00:47:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-3ce27235-df7a-458a-ba31-e63694ec5cb4 tempest-ProjectReaderTests-619335768 None] Lock "cinder-31476bd4-8eee-408a-a2f2-0e169d3257e2-delete_snapshot" released by "delete_snapshot" :: held 3.587s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:35 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cbaa009b-3fb0-4b4e-bea7-a086e6a5a157 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2.e5afbb09-2bc0-42f9-be30-6386c7d36f51" returned: 0 in 0.651s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cbaa009b-3fb0-4b4e-bea7-a086e6a5a157 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:35 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2.info Jul 10 00:47:35 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:35 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-80a31176-439c-4db4-b96b-d70ad46f4b4c tempest-SnapshotDependencyTests-390917841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.702s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:35 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-80a31176-439c-4db4-b96b-d70ad46f4b4c tempest-SnapshotDependencyTests-390917841 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:47:35 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-80a31176-439c-4db4-b96b-d70ad46f4b4c tempest-SnapshotDependencyTests-390917841 None] Deleted volume successfully. Jul 10 00:47:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-80a31176-439c-4db4-b96b-d70ad46f4b4c tempest-SnapshotDependencyTests-390917841 None] Lock "cinder-27d8e6fb-436b-4135-aaa1-6287b7d08dd4-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e3d8df53-5040-4203-b9c5-027bbf366038 tempest-ProjectReaderTests-619335768 None] Acquiring lock "cinder-c3f3df44-1f86-4a6c-ac5f-b3732441870d-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e3d8df53-5040-4203-b9c5-027bbf366038 tempest-ProjectReaderTests-619335768 None] Lock "cinder-c3f3df44-1f86-4a6c-ac5f-b3732441870d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e3d8df53-5040-4203-b9c5-027bbf366038 tempest-ProjectReaderTests-619335768 None] Acquiring lock "cinder-quobyte-c3f3df44-1f86-4a6c-ac5f-b3732441870d" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:35 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e3d8df53-5040-4203-b9c5-027bbf366038 tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-c3f3df44-1f86-4a6c-ac5f-b3732441870d" acquired by "delete_volume" :: waited 0.020s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:35 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc13a17d-e4c6-417c-bf8b-6ebf382688d0]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e3d8df53-5040-4203-b9c5-027bbf366038 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:35 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d Jul 10 00:47:35 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:36 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cbaa009b-3fb0-4b4e-bea7-a086e6a5a157 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2.info" returned: 0 in 0.755s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:36 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-cbaa009b-3fb0-4b4e-bea7-a086e6a5a157 tempest-ProjectMemberTests-1755578239 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2.info is being set with open permissions: ugo+rw Jul 10 00:47:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cbaa009b-3fb0-4b4e-bea7-a086e6a5a157 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:36 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2.info Jul 10 00:47:36 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:36 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e3d8df53-5040-4203-b9c5-027bbf366038 tempest-ProjectReaderTests-619335768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d" returned: 0 in 0.855s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e3d8df53-5040-4203-b9c5-027bbf366038 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:36 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d Jul 10 00:47:36 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:36 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cbaa009b-3fb0-4b4e-bea7-a086e6a5a157 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2.info" returned: 0 in 0.711s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-cbaa009b-3fb0-4b4e-bea7-a086e6a5a157 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.633s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:36 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-cbaa009b-3fb0-4b4e-bea7-a086e6a5a157 tempest-ProjectMemberTests-1755578239 None] Create snapshot completed successfully Jul 10 00:47:37 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e3d8df53-5040-4203-b9c5-027bbf366038 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-c3f3df44-1f86-4a6c-ac5f-b3732441870d" returned: 0 in 0.685s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:37 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e3d8df53-5040-4203-b9c5-027bbf366038 tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-c3f3df44-1f86-4a6c-ac5f-b3732441870d" released by "delete_volume" :: held 1.596s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:37 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-e3d8df53-5040-4203-b9c5-027bbf366038 tempest-ProjectReaderTests-619335768 None] Created reservations ['e0f49bda-056e-42d5-9297-22b1b8dbbad9', '920d113e-16af-4024-9a6e-80a73b500761', 'edcf1127-f146-4900-b3e8-5c50dc6fec6d', '6d143252-8cd6-466a-b38b-9a8d74c5fbd8'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:47:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e3d8df53-5040-4203-b9c5-027bbf366038 tempest-ProjectReaderTests-619335768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e3d8df53-5040-4203-b9c5-027bbf366038 tempest-ProjectReaderTests-619335768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e3d8df53-5040-4203-b9c5-027bbf366038 tempest-ProjectReaderTests-619335768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e3d8df53-5040-4203-b9c5-027bbf366038 tempest-ProjectReaderTests-619335768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e3d8df53-5040-4203-b9c5-027bbf366038 tempest-ProjectReaderTests-619335768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e3d8df53-5040-4203-b9c5-027bbf366038 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:37 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-17e7630c-5f0a-4093-b00d-731156f214d1 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-e5afbb09-2bc0-42f9-be30-6386c7d36f51-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:37 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:47:37 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:37 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-17e7630c-5f0a-4093-b00d-731156f214d1 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-e5afbb09-2bc0-42f9-be30-6386c7d36f51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:37 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-17e7630c-5f0a-4093-b00d-731156f214d1 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-b0142605-c123-4dd5-b72f-559d47f957f2" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:37 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-17e7630c-5f0a-4093-b00d-731156f214d1 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-b0142605-c123-4dd5-b72f-559d47f957f2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:37 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-17e7630c-5f0a-4093-b00d-731156f214d1 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-e5afbb09-2bc0-42f9-be30-6386c7d36f51" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:37 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-17e7630c-5f0a-4093-b00d-731156f214d1 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-e5afbb09-2bc0-42f9-be30-6386c7d36f51" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-17e7630c-5f0a-4093-b00d-731156f214d1 tempest-ProjectMemberTests-1755578239 None] Deleting offline snapshot e5afbb09-2bc0-42f9-be30-6386c7d36f51 of volume b0142605-c123-4dd5-b72f-559d47f957f2 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:47:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-17e7630c-5f0a-4093-b00d-731156f214d1 tempest-ProjectMemberTests-1755578239 None] snapshot_file for this snap is: volume-b0142605-c123-4dd5-b72f-559d47f957f2.e5afbb09-2bc0-42f9-be30-6386c7d36f51 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:47:37 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80d32ce-8c8f-4eaa-9b71-7bdc860daabc]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-17e7630c-5f0a-4093-b00d-731156f214d1 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2.e5afbb09-2bc0-42f9-be30-6386c7d36f51 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:37 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2.e5afbb09-2bc0-42f9-be30-6386c7d36f51 Jul 10 00:47:37 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:38 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e3d8df53-5040-4203-b9c5-027bbf366038 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.731s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-e3d8df53-5040-4203-b9c5-027bbf366038 tempest-ProjectReaderTests-619335768 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:47:38 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-e3d8df53-5040-4203-b9c5-027bbf366038 tempest-ProjectReaderTests-619335768 None] Deleted volume successfully. Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e3d8df53-5040-4203-b9c5-027bbf366038 tempest-ProjectReaderTests-619335768 None] Lock "cinder-c3f3df44-1f86-4a6c-ac5f-b3732441870d-delete_volume" released by "delete_volume" :: held 2.596s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Flow 'volume_create_manager' (d14fbd32-42e9-4e82-9967-2ebf5d2d1ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eecff281-1ba0-496a-97c6-0de06d0590f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eecff281-1ba0-496a-97c6-0de06d0590f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-598802662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b78d41a9-2420-4d64-a495-ba85606ef76e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ea29ee052f4b8aac142f6ce2eb3d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:38Z,use_quota=True,user_id='9c4f444d003740afbc235bc3741be420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af2e457e-fb9f-4d87-8678-dea7dbdd4aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af2e457e-fb9f-4d87-8678-dea7dbdd4aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b420266-cc7f-418d-8bf7-6300b198c948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b420266-cc7f-418d-8bf7-6300b198c948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b78d41a9-2420-4d64-a495-ba85606ef76e', 'volume_name': 'volume-b78d41a9-2420-4d64-a495-ba85606ef76e', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bfaf109-368a-4d7c-8dfa-97b05f9fae92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bfaf109-368a-4d7c-8dfa-97b05f9fae92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7940052-fafb-4962-ad40-7fb0a7922e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:38 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Volume b78d41a9-2420-4d64-a495-ba85606ef76e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b78d41a9-2420-4d64-a495-ba85606ef76e', 'volume_size': 1} Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-598802662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b78d41a9-2420-4d64-a495-ba85606ef76e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ea29ee052f4b8aac142f6ce2eb3d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:38Z,use_quota=True,user_id='9c4f444d003740afbc235bc3741be420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Creating volume b78d41a9-2420-4d64-a495-ba85606ef76e {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:47:38 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:38 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e 1073741824 Jul 10 00:47:38 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:38 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-17e7630c-5f0a-4093-b00d-731156f214d1 tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2.e5afbb09-2bc0-42f9-be30-6386c7d36f51" returned: 0 in 1.035s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-17e7630c-5f0a-4093-b00d-731156f214d1 tempest-ProjectMemberTests-1755578239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0142605-c123-4dd5-b72f-559d47f957f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbcf02d-0ad6-408d-86e6-cec37864bd28]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-17e7630c-5f0a-4093-b00d-731156f214d1 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:38 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2 Jul 10 00:47:38 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:39 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-17e7630c-5f0a-4093-b00d-731156f214d1 tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2" returned: 0 in 0.893s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-17e7630c-5f0a-4093-b00d-731156f214d1 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2.e5afbb09-2bc0-42f9-be30-6386c7d36f51 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:39 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e 1073741824" returned: 0 in 0.993s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:39 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2.e5afbb09-2bc0-42f9-be30-6386c7d36f51 Jul 10 00:47:39 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:39 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e Jul 10 00:47:39 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:40 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e" returned: 0 in 0.660s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:47:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7940052-fafb-4962-ad40-7fb0a7922e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b78d41a9-2420-4d64-a495-ba85606ef76e', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2de61b0-1fa1-49ae-ab69-78a11bbc7699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:40 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Volume volume-b78d41a9-2420-4d64-a495-ba85606ef76e (b78d41a9-2420-4d64-a495-ba85606ef76e): created successfully Jul 10 00:47:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2de61b0-1fa1-49ae-ab69-78a11bbc7699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:40 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Flow 'volume_create_manager' (d14fbd32-42e9-4e82-9967-2ebf5d2d1ab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:40 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-7105b8ac-338c-4749-b5d9-a9162a30f88f tempest-ProjectReaderTests-619335768 None] Created volume successfully. Jul 10 00:47:40 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-17e7630c-5f0a-4093-b00d-731156f214d1 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2.e5afbb09-2bc0-42f9-be30-6386c7d36f51" returned: 0 in 0.839s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-17e7630c-5f0a-4093-b00d-731156f214d1 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2.e5afbb09-2bc0-42f9-be30-6386c7d36f51 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:40 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2.e5afbb09-2bc0-42f9-be30-6386c7d36f51 Jul 10 00:47:40 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8e8f629f-56d8-44f9-a755-b6ead79087b8 tempest-ProjectReaderTests-619335768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8e8f629f-56d8-44f9-a755-b6ead79087b8 tempest-ProjectReaderTests-619335768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:40 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8e8f629f-56d8-44f9-a755-b6ead79087b8 tempest-ProjectReaderTests-619335768 None] Creating offline snapshot 3a880077-f1cf-468b-b1b2-e29198e271e9 of volume b78d41a9-2420-4d64-a495-ba85606ef76e {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:47:40 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b693e18-348c-40b3-bdf6-739fcd09dd17]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8e8f629f-56d8-44f9-a755-b6ead79087b8 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:40 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e Jul 10 00:47:40 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:41 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-17e7630c-5f0a-4093-b00d-731156f214d1 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2.e5afbb09-2bc0-42f9-be30-6386c7d36f51" returned: 0 in 0.779s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:41 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-17e7630c-5f0a-4093-b00d-731156f214d1 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-e5afbb09-2bc0-42f9-be30-6386c7d36f51" released by "_delete_snapshot" :: held 3.658s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:41 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-17e7630c-5f0a-4093-b00d-731156f214d1 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-b0142605-c123-4dd5-b72f-559d47f957f2" released by "delete_snapshot" :: held 3.683s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:41 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-17e7630c-5f0a-4093-b00d-731156f214d1 tempest-ProjectMemberTests-1755578239 None] Created reservations ['b2f4ca62-4db0-4305-860e-a66a8c4d6df9', 'f105d74b-ffb6-41ff-949c-a2b6bc20a941', 'b2f5cbec-eb41-4f29-9b3f-d1e1af039ab0', 'd0da9bba-b349-45bc-ab56-7d7140537f63'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:47:41 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-17e7630c-5f0a-4093-b00d-731156f214d1 tempest-ProjectMemberTests-1755578239 None] Delete snapshot completed successfully. Jul 10 00:47:41 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-17e7630c-5f0a-4093-b00d-731156f214d1 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-e5afbb09-2bc0-42f9-be30-6386c7d36f51-delete_snapshot" released by "delete_snapshot" :: held 3.875s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:41 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8e8f629f-56d8-44f9-a755-b6ead79087b8 tempest-ProjectReaderTests-619335768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e" returned: 0 in 0.795s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8e8f629f-56d8-44f9-a755-b6ead79087b8 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e.3a880077-f1cf-468b-b1b2-e29198e271e9 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:41 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e.3a880077-f1cf-468b-b1b2-e29198e271e9 1G Jul 10 00:47:41 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:41 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7c008c0c-de0d-49e2-aff2-cab46789bbfd tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-b0142605-c123-4dd5-b72f-559d47f957f2-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:41 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7c008c0c-de0d-49e2-aff2-cab46789bbfd tempest-ProjectMemberTests-1755578239 None] Lock "cinder-b0142605-c123-4dd5-b72f-559d47f957f2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:41 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7c008c0c-de0d-49e2-aff2-cab46789bbfd tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-b0142605-c123-4dd5-b72f-559d47f957f2" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:41 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7c008c0c-de0d-49e2-aff2-cab46789bbfd tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-b0142605-c123-4dd5-b72f-559d47f957f2" acquired by "delete_volume" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:41 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[623902d4-070a-4263-8b94-67931a362d56]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7c008c0c-de0d-49e2-aff2-cab46789bbfd tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:42 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2 Jul 10 00:47:42 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:42 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8e8f629f-56d8-44f9-a755-b6ead79087b8 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e.3a880077-f1cf-468b-b1b2-e29198e271e9 1G" returned: 0 in 1.062s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8e8f629f-56d8-44f9-a755-b6ead79087b8 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b78d41a9-2420-4d64-a495-ba85606ef76e -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e.3a880077-f1cf-468b-b1b2-e29198e271e9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:42 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b78d41a9-2420-4d64-a495-ba85606ef76e -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e.3a880077-f1cf-468b-b1b2-e29198e271e9 Jul 10 00:47:42 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:42 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7c008c0c-de0d-49e2-aff2-cab46789bbfd tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2" returned: 0 in 0.894s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7c008c0c-de0d-49e2-aff2-cab46789bbfd tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:42 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2 Jul 10 00:47:42 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:43 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:43 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8e8f629f-56d8-44f9-a755-b6ead79087b8 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b78d41a9-2420-4d64-a495-ba85606ef76e -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e.3a880077-f1cf-468b-b1b2-e29198e271e9" returned: 0 in 0.782s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:43 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-8e8f629f-56d8-44f9-a755-b6ead79087b8 tempest-ProjectReaderTests-619335768 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e.3a880077-f1cf-468b-b1b2-e29198e271e9 is being set with open permissions: ugo+rw Jul 10 00:47:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8e8f629f-56d8-44f9-a755-b6ead79087b8 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e.3a880077-f1cf-468b-b1b2-e29198e271e9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7c008c0c-de0d-49e2-aff2-cab46789bbfd tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b0142605-c123-4dd5-b72f-559d47f957f2" returned: 0 in 0.714s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:43 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e.3a880077-f1cf-468b-b1b2-e29198e271e9 Jul 10 00:47:43 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7c008c0c-de0d-49e2-aff2-cab46789bbfd tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-b0142605-c123-4dd5-b72f-559d47f957f2" released by "delete_volume" :: held 1.678s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:43 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-7c008c0c-de0d-49e2-aff2-cab46789bbfd tempest-ProjectMemberTests-1755578239 None] Created reservations ['1e717ef8-ca75-444a-ad95-67328288ff8c', '0d8f8818-bf39-4248-81e3-b5f6e5d3c9df', 'b94e2b9f-69c9-443f-b80f-cfc17928afb8', '1e2cc858-e4ee-491e-a885-50d6ddccb28f'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:47:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7c008c0c-de0d-49e2-aff2-cab46789bbfd tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7c008c0c-de0d-49e2-aff2-cab46789bbfd tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7c008c0c-de0d-49e2-aff2-cab46789bbfd tempest-ProjectMemberTests-1755578239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7c008c0c-de0d-49e2-aff2-cab46789bbfd tempest-ProjectMemberTests-1755578239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7c008c0c-de0d-49e2-aff2-cab46789bbfd tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7c008c0c-de0d-49e2-aff2-cab46789bbfd tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:43 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:47:43 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:44 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8e8f629f-56d8-44f9-a755-b6ead79087b8 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e.3a880077-f1cf-468b-b1b2-e29198e271e9" returned: 0 in 0.761s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8e8f629f-56d8-44f9-a755-b6ead79087b8 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:44 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e.info Jul 10 00:47:44 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:44 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7c008c0c-de0d-49e2-aff2-cab46789bbfd tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.919s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:44 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-7c008c0c-de0d-49e2-aff2-cab46789bbfd tempest-ProjectMemberTests-1755578239 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:47:44 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-7c008c0c-de0d-49e2-aff2-cab46789bbfd tempest-ProjectMemberTests-1755578239 None] Deleted volume successfully. Jul 10 00:47:44 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7c008c0c-de0d-49e2-aff2-cab46789bbfd tempest-ProjectMemberTests-1755578239 None] Lock "cinder-b0142605-c123-4dd5-b72f-559d47f957f2-delete_volume" released by "delete_volume" :: held 2.876s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:44 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:47:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Flow 'volume_create_manager' (01dd40a4-0671-4cbf-a11c-8b7403905cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d429ca-0400-4667-991f-986b10b9109d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d429ca-0400-4667-991f-986b10b9109d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-369006102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001a3fff-2192-4474-a9d3-d4a477ae57a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f238e094d83c41769907fe7fe98cb92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:45Z,use_quota=True,user_id='6ae3ebc77379400a81756522642f35cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346fd4f1-8160-484d-a99e-16623f7739ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346fd4f1-8160-484d-a99e-16623f7739ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558c18ff-eac0-4bb5-a7ea-802ff17abe38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558c18ff-eac0-4bb5-a7ea-802ff17abe38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '001a3fff-2192-4474-a9d3-d4a477ae57a7', 'volume_name': 'volume-001a3fff-2192-4474-a9d3-d4a477ae57a7', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a633a67-dd51-4ac5-bbbe-e0967693ad0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a633a67-dd51-4ac5-bbbe-e0967693ad0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:44 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eacdebc2-2e96-4f08-b6bb-058af39d287f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:44 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Volume 001a3fff-2192-4474-a9d3-d4a477ae57a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-001a3fff-2192-4474-a9d3-d4a477ae57a7', 'volume_size': 1} Jul 10 00:47:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:45 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8e8f629f-56d8-44f9-a755-b6ead79087b8 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e.info" returned: 0 in 0.766s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:45 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-8e8f629f-56d8-44f9-a755-b6ead79087b8 tempest-ProjectReaderTests-619335768 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e.info is being set with open permissions: ugo+rw Jul 10 00:47:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8e8f629f-56d8-44f9-a755-b6ead79087b8 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:45 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e.info Jul 10 00:47:45 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:45 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8e8f629f-56d8-44f9-a755-b6ead79087b8 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e.info" returned: 0 in 0.663s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-8e8f629f-56d8-44f9-a755-b6ead79087b8 tempest-ProjectReaderTests-619335768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.952s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-369006102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001a3fff-2192-4474-a9d3-d4a477ae57a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f238e094d83c41769907fe7fe98cb92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:45Z,use_quota=True,user_id='6ae3ebc77379400a81756522642f35cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:47:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Creating volume 001a3fff-2192-4474-a9d3-d4a477ae57a7 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:47:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:47:45 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:47:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:45 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7 1073741824 Jul 10 00:47:45 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:45 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-8e8f629f-56d8-44f9-a755-b6ead79087b8 tempest-ProjectReaderTests-619335768 None] Create snapshot completed successfully Jul 10 00:47:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c248f5e2-51dc-4246-bd15-7f8a823caf5d tempest-ProjectReaderTests-619335768 None] Acquiring lock "cinder-3a880077-f1cf-468b-b1b2-e29198e271e9-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c248f5e2-51dc-4246-bd15-7f8a823caf5d tempest-ProjectReaderTests-619335768 None] Lock "cinder-3a880077-f1cf-468b-b1b2-e29198e271e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c248f5e2-51dc-4246-bd15-7f8a823caf5d tempest-ProjectReaderTests-619335768 None] Acquiring lock "cinder-quobyte-b78d41a9-2420-4d64-a495-ba85606ef76e" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c248f5e2-51dc-4246-bd15-7f8a823caf5d tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-b78d41a9-2420-4d64-a495-ba85606ef76e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c248f5e2-51dc-4246-bd15-7f8a823caf5d tempest-ProjectReaderTests-619335768 None] Acquiring lock "cinder-quobyte-3a880077-f1cf-468b-b1b2-e29198e271e9" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:46 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c248f5e2-51dc-4246-bd15-7f8a823caf5d tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-3a880077-f1cf-468b-b1b2-e29198e271e9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:46 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-c248f5e2-51dc-4246-bd15-7f8a823caf5d tempest-ProjectReaderTests-619335768 None] Deleting offline snapshot 3a880077-f1cf-468b-b1b2-e29198e271e9 of volume b78d41a9-2420-4d64-a495-ba85606ef76e {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:47:46 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-c248f5e2-51dc-4246-bd15-7f8a823caf5d tempest-ProjectReaderTests-619335768 None] snapshot_file for this snap is: volume-b78d41a9-2420-4d64-a495-ba85606ef76e.3a880077-f1cf-468b-b1b2-e29198e271e9 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:47:46 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc75014-0c89-4879-ba6e-694fc3586943]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c248f5e2-51dc-4246-bd15-7f8a823caf5d tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e.3a880077-f1cf-468b-b1b2-e29198e271e9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:46 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e.3a880077-f1cf-468b-b1b2-e29198e271e9 Jul 10 00:47:46 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:46 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7 1073741824" returned: 0 in 0.810s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:46 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7 Jul 10 00:47:46 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:46 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c248f5e2-51dc-4246-bd15-7f8a823caf5d tempest-ProjectReaderTests-619335768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e.3a880077-f1cf-468b-b1b2-e29198e271e9" returned: 0 in 0.738s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:46 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-c248f5e2-51dc-4246-bd15-7f8a823caf5d tempest-ProjectReaderTests-619335768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b78d41a9-2420-4d64-a495-ba85606ef76e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:47:46 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de99c57-313e-4bad-afc8-2e69e03192ba]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c248f5e2-51dc-4246-bd15-7f8a823caf5d tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:47 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e Jul 10 00:47:47 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:47 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7" returned: 0 in 0.654s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:47:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eacdebc2-2e96-4f08-b6bb-058af39d287f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-001a3fff-2192-4474-a9d3-d4a477ae57a7', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1f13fa-6677-4533-ae47-b539a2baf5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:47 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Volume volume-001a3fff-2192-4474-a9d3-d4a477ae57a7 (001a3fff-2192-4474-a9d3-d4a477ae57a7): created successfully Jul 10 00:47:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1f13fa-6677-4533-ae47-b539a2baf5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:47 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Flow 'volume_create_manager' (01dd40a4-0671-4cbf-a11c-8b7403905cac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:47 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-b575b6eb-892e-4a95-ab14-d6aaf2cb8bee tempest-ProjectMemberTests-1755578239 None] Created volume successfully. Jul 10 00:47:47 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c248f5e2-51dc-4246-bd15-7f8a823caf5d tempest-ProjectReaderTests-619335768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e" returned: 0 in 0.753s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c248f5e2-51dc-4246-bd15-7f8a823caf5d tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e.3a880077-f1cf-468b-b1b2-e29198e271e9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:47 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e.3a880077-f1cf-468b-b1b2-e29198e271e9 Jul 10 00:47:47 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b4c7aef0-ea5a-4eb3-9b12-25cc6de38d08 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b4c7aef0-ea5a-4eb3-9b12-25cc6de38d08 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:47 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-b4c7aef0-ea5a-4eb3-9b12-25cc6de38d08 tempest-ProjectMemberTests-1755578239 None] Creating offline snapshot c391e395-c36f-49ca-9ccf-6f954335bb97 of volume 001a3fff-2192-4474-a9d3-d4a477ae57a7 {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:47:47 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c48299-9fde-4af8-b758-894e76b5ea57]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b4c7aef0-ea5a-4eb3-9b12-25cc6de38d08 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:48 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7 Jul 10 00:47:48 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:48 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c248f5e2-51dc-4246-bd15-7f8a823caf5d tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e.3a880077-f1cf-468b-b1b2-e29198e271e9" returned: 0 in 0.718s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c248f5e2-51dc-4246-bd15-7f8a823caf5d tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e.3a880077-f1cf-468b-b1b2-e29198e271e9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:48 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e.3a880077-f1cf-468b-b1b2-e29198e271e9 Jul 10 00:47:48 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:48 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b4c7aef0-ea5a-4eb3-9b12-25cc6de38d08 tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7" returned: 0 in 0.761s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b4c7aef0-ea5a-4eb3-9b12-25cc6de38d08 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.c391e395-c36f-49ca-9ccf-6f954335bb97 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:48 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.c391e395-c36f-49ca-9ccf-6f954335bb97 1G Jul 10 00:47:48 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:49 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c248f5e2-51dc-4246-bd15-7f8a823caf5d tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e.3a880077-f1cf-468b-b1b2-e29198e271e9" returned: 0 in 0.645s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c248f5e2-51dc-4246-bd15-7f8a823caf5d tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-3a880077-f1cf-468b-b1b2-e29198e271e9" released by "_delete_snapshot" :: held 2.953s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c248f5e2-51dc-4246-bd15-7f8a823caf5d tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-b78d41a9-2420-4d64-a495-ba85606ef76e" released by "delete_snapshot" :: held 2.981s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:49 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-c248f5e2-51dc-4246-bd15-7f8a823caf5d tempest-ProjectReaderTests-619335768 None] Created reservations ['10da8299-73a8-45f4-8c58-628923098952', '784851fb-9e38-4e42-95c1-0396d8c9aa77', '9dbe75da-2142-49cb-a5b5-ffe56ee06797', 'd060bad5-42a3-4dbb-8f11-5373bce7b44b'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:47:49 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-c248f5e2-51dc-4246-bd15-7f8a823caf5d tempest-ProjectReaderTests-619335768 None] Delete snapshot completed successfully. Jul 10 00:47:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c248f5e2-51dc-4246-bd15-7f8a823caf5d tempest-ProjectReaderTests-619335768 None] Lock "cinder-3a880077-f1cf-468b-b1b2-e29198e271e9-delete_snapshot" released by "delete_snapshot" :: held 3.133s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d5f0b460-e2b7-4f31-b0d7-7c4e74bcf57f tempest-ProjectReaderTests-619335768 None] Acquiring lock "cinder-b78d41a9-2420-4d64-a495-ba85606ef76e-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d5f0b460-e2b7-4f31-b0d7-7c4e74bcf57f tempest-ProjectReaderTests-619335768 None] Lock "cinder-b78d41a9-2420-4d64-a495-ba85606ef76e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d5f0b460-e2b7-4f31-b0d7-7c4e74bcf57f tempest-ProjectReaderTests-619335768 None] Acquiring lock "cinder-quobyte-b78d41a9-2420-4d64-a495-ba85606ef76e" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:49 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d5f0b460-e2b7-4f31-b0d7-7c4e74bcf57f tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-b78d41a9-2420-4d64-a495-ba85606ef76e" acquired by "delete_volume" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:49 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4840d1-8b5a-4443-ac4c-14a09687a1c6]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d5f0b460-e2b7-4f31-b0d7-7c4e74bcf57f tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:49 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e Jul 10 00:47:49 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:49 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b4c7aef0-ea5a-4eb3-9b12-25cc6de38d08 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.c391e395-c36f-49ca-9ccf-6f954335bb97 1G" returned: 0 in 0.888s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b4c7aef0-ea5a-4eb3-9b12-25cc6de38d08 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-001a3fff-2192-4474-a9d3-d4a477ae57a7 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.c391e395-c36f-49ca-9ccf-6f954335bb97 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:49 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-001a3fff-2192-4474-a9d3-d4a477ae57a7 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.c391e395-c36f-49ca-9ccf-6f954335bb97 Jul 10 00:47:49 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:50 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d5f0b460-e2b7-4f31-b0d7-7c4e74bcf57f tempest-ProjectReaderTests-619335768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e" returned: 0 in 0.744s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d5f0b460-e2b7-4f31-b0d7-7c4e74bcf57f tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:50 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e Jul 10 00:47:50 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:50 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b4c7aef0-ea5a-4eb3-9b12-25cc6de38d08 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-001a3fff-2192-4474-a9d3-d4a477ae57a7 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.c391e395-c36f-49ca-9ccf-6f954335bb97" returned: 0 in 0.667s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:50 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-b4c7aef0-ea5a-4eb3-9b12-25cc6de38d08 tempest-ProjectMemberTests-1755578239 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.c391e395-c36f-49ca-9ccf-6f954335bb97 is being set with open permissions: ugo+rw Jul 10 00:47:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b4c7aef0-ea5a-4eb3-9b12-25cc6de38d08 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.c391e395-c36f-49ca-9ccf-6f954335bb97 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:50 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.c391e395-c36f-49ca-9ccf-6f954335bb97 Jul 10 00:47:50 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:50 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d5f0b460-e2b7-4f31-b0d7-7c4e74bcf57f tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-b78d41a9-2420-4d64-a495-ba85606ef76e" returned: 0 in 0.631s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:50 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d5f0b460-e2b7-4f31-b0d7-7c4e74bcf57f tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-b78d41a9-2420-4d64-a495-ba85606ef76e" released by "delete_volume" :: held 1.428s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:50 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-d5f0b460-e2b7-4f31-b0d7-7c4e74bcf57f tempest-ProjectReaderTests-619335768 None] Created reservations ['4290bf92-daf8-4390-9b3f-82021d396e06', '1974b1d6-8471-4c14-b709-301d5b3ccc70', '0747bd01-0c76-457a-b1ec-32dd76c2eca3', '3f251fae-380c-4395-bfeb-fa6d8afe24d8'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:47:50 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b4c7aef0-ea5a-4eb3-9b12-25cc6de38d08 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.c391e395-c36f-49ca-9ccf-6f954335bb97" returned: 0 in 0.621s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d5f0b460-e2b7-4f31-b0d7-7c4e74bcf57f tempest-ProjectReaderTests-619335768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d5f0b460-e2b7-4f31-b0d7-7c4e74bcf57f tempest-ProjectReaderTests-619335768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d5f0b460-e2b7-4f31-b0d7-7c4e74bcf57f tempest-ProjectReaderTests-619335768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d5f0b460-e2b7-4f31-b0d7-7c4e74bcf57f tempest-ProjectReaderTests-619335768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d5f0b460-e2b7-4f31-b0d7-7c4e74bcf57f tempest-ProjectReaderTests-619335768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d5f0b460-e2b7-4f31-b0d7-7c4e74bcf57f tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:50 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:47:50 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b4c7aef0-ea5a-4eb3-9b12-25cc6de38d08 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:50 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.info Jul 10 00:47:50 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:51 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d5f0b460-e2b7-4f31-b0d7-7c4e74bcf57f tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.618s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:51 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-d5f0b460-e2b7-4f31-b0d7-7c4e74bcf57f tempest-ProjectReaderTests-619335768 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:47:51 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-d5f0b460-e2b7-4f31-b0d7-7c4e74bcf57f tempest-ProjectReaderTests-619335768 None] Deleted volume successfully. Jul 10 00:47:51 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-d5f0b460-e2b7-4f31-b0d7-7c4e74bcf57f tempest-ProjectReaderTests-619335768 None] Lock "cinder-b78d41a9-2420-4d64-a495-ba85606ef76e-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:51 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b4c7aef0-ea5a-4eb3-9b12-25cc6de38d08 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.info" returned: 0 in 0.645s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:51 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-b4c7aef0-ea5a-4eb3-9b12-25cc6de38d08 tempest-ProjectMemberTests-1755578239 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.info is being set with open permissions: ugo+rw Jul 10 00:47:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b4c7aef0-ea5a-4eb3-9b12-25cc6de38d08 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:51 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.info Jul 10 00:47:51 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:51 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:47:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Flow 'volume_create_manager' (16151995-69cf-43af-bf52-847750bbc3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc0c7c3-5d75-4f4d-8ec4-52771608b93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bc0c7c3-5d75-4f4d-8ec4-52771608b93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1244293774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6495f4c0-1876-4ede-8ea4-ddb4cc8600de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ea29ee052f4b8aac142f6ce2eb3d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:52Z,use_quota=True,user_id='9c4f444d003740afbc235bc3741be420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e946b998-3992-42f6-8acd-4819e5b60846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e946b998-3992-42f6-8acd-4819e5b60846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26bb7fc3-242b-4991-a704-a3540df49b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26bb7fc3-242b-4991-a704-a3540df49b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6495f4c0-1876-4ede-8ea4-ddb4cc8600de', 'volume_name': 'volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b19b42d-1576-4b4b-a415-528e6c6504a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b19b42d-1576-4b4b-a415-528e6c6504a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:52 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c351538f-39ec-4b66-a9a5-5529b793bacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:52 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Volume 6495f4c0-1876-4ede-8ea4-ddb4cc8600de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de', 'volume_size': 1} Jul 10 00:47:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:52 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-b4c7aef0-ea5a-4eb3-9b12-25cc6de38d08 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.info" returned: 0 in 0.625s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-b4c7aef0-ea5a-4eb3-9b12-25cc6de38d08 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.306s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.141s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:52 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1244293774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6495f4c0-1876-4ede-8ea4-ddb4cc8600de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ea29ee052f4b8aac142f6ce2eb3d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:47:52Z,use_quota=True,user_id='9c4f444d003740afbc235bc3741be420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:47:52 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Creating volume 6495f4c0-1876-4ede-8ea4-ddb4cc8600de {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:47:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:52 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:52 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:52 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:47:52 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:47:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:52 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de 1073741824 Jul 10 00:47:52 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:52 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-b4c7aef0-ea5a-4eb3-9b12-25cc6de38d08 tempest-ProjectMemberTests-1755578239 None] Create snapshot completed successfully Jul 10 00:47:53 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de 1073741824" returned: 0 in 0.822s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:53 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de Jul 10 00:47:53 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-cf862b06-585a-49ff-aadc-4149055ced7f tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-c391e395-c36f-49ca-9ccf-6f954335bb97-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-cf862b06-585a-49ff-aadc-4149055ced7f tempest-ProjectMemberTests-1755578239 None] Lock "cinder-c391e395-c36f-49ca-9ccf-6f954335bb97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-cf862b06-585a-49ff-aadc-4149055ced7f tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-001a3fff-2192-4474-a9d3-d4a477ae57a7" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-cf862b06-585a-49ff-aadc-4149055ced7f tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-001a3fff-2192-4474-a9d3-d4a477ae57a7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-cf862b06-585a-49ff-aadc-4149055ced7f tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-c391e395-c36f-49ca-9ccf-6f954335bb97" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-cf862b06-585a-49ff-aadc-4149055ced7f tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-c391e395-c36f-49ca-9ccf-6f954335bb97" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-cf862b06-585a-49ff-aadc-4149055ced7f tempest-ProjectMemberTests-1755578239 None] Deleting offline snapshot c391e395-c36f-49ca-9ccf-6f954335bb97 of volume 001a3fff-2192-4474-a9d3-d4a477ae57a7 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:47:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-cf862b06-585a-49ff-aadc-4149055ced7f tempest-ProjectMemberTests-1755578239 None] snapshot_file for this snap is: volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.c391e395-c36f-49ca-9ccf-6f954335bb97 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:47:53 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[802f0343-08ea-4e56-bf07-3515e7a14237]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cf862b06-585a-49ff-aadc-4149055ced7f tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.c391e395-c36f-49ca-9ccf-6f954335bb97 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:53 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.c391e395-c36f-49ca-9ccf-6f954335bb97 Jul 10 00:47:53 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:53 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de" returned: 0 in 0.632s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:47:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c351538f-39ec-4b66-a9a5-5529b793bacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a73b81-2d7d-41b4-a7d7-ea0ddc9ff3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:47:53 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Volume volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de (6495f4c0-1876-4ede-8ea4-ddb4cc8600de): created successfully Jul 10 00:47:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a73b81-2d7d-41b4-a7d7-ea0ddc9ff3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:47:53 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Flow 'volume_create_manager' (16151995-69cf-43af-bf52-847750bbc3ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:47:53 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-d0c11799-f6ed-42f0-b919-e123b5688289 tempest-ProjectReaderTests-619335768 None] Created volume successfully. Jul 10 00:47:53 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cf862b06-585a-49ff-aadc-4149055ced7f tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.c391e395-c36f-49ca-9ccf-6f954335bb97" returned: 0 in 0.780s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:53 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-cf862b06-585a-49ff-aadc-4149055ced7f tempest-ProjectMemberTests-1755578239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-001a3fff-2192-4474-a9d3-d4a477ae57a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:47:54 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a46e0f-0380-4cf7-adc1-9c6a8caf7aa3]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cf862b06-585a-49ff-aadc-4149055ced7f tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:54 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7 Jul 10 00:47:54 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3b2a2cb2-43d0-4a6d-a35f-9eb6b7b12bdc tempest-ProjectReaderTests-619335768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3b2a2cb2-43d0-4a6d-a35f-9eb6b7b12bdc tempest-ProjectReaderTests-619335768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:54 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-3b2a2cb2-43d0-4a6d-a35f-9eb6b7b12bdc tempest-ProjectReaderTests-619335768 None] Creating offline snapshot d734931a-b842-4690-8e65-5ffd6e20bfac of volume 6495f4c0-1876-4ede-8ea4-ddb4cc8600de {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:47:54 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad9385d-37b0-4fa1-b8e6-97102336a5f6]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3b2a2cb2-43d0-4a6d-a35f-9eb6b7b12bdc tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:54 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de Jul 10 00:47:54 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:54 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cf862b06-585a-49ff-aadc-4149055ced7f tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7" returned: 0 in 0.778s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cf862b06-585a-49ff-aadc-4149055ced7f tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.c391e395-c36f-49ca-9ccf-6f954335bb97 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:54 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.c391e395-c36f-49ca-9ccf-6f954335bb97 Jul 10 00:47:54 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:54 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3b2a2cb2-43d0-4a6d-a35f-9eb6b7b12bdc tempest-ProjectReaderTests-619335768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de" returned: 0 in 0.738s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3b2a2cb2-43d0-4a6d-a35f-9eb6b7b12bdc tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.d734931a-b842-4690-8e65-5ffd6e20bfac 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:55 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.d734931a-b842-4690-8e65-5ffd6e20bfac 1G Jul 10 00:47:55 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:55 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cf862b06-585a-49ff-aadc-4149055ced7f tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.c391e395-c36f-49ca-9ccf-6f954335bb97" returned: 0 in 0.741s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cf862b06-585a-49ff-aadc-4149055ced7f tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.c391e395-c36f-49ca-9ccf-6f954335bb97 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:55 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.c391e395-c36f-49ca-9ccf-6f954335bb97 Jul 10 00:47:55 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:55 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3b2a2cb2-43d0-4a6d-a35f-9eb6b7b12bdc tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.d734931a-b842-4690-8e65-5ffd6e20bfac 1G" returned: 0 in 0.785s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3b2a2cb2-43d0-4a6d-a35f-9eb6b7b12bdc tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.d734931a-b842-4690-8e65-5ffd6e20bfac {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:55 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.d734931a-b842-4690-8e65-5ffd6e20bfac Jul 10 00:47:55 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:56 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-cf862b06-585a-49ff-aadc-4149055ced7f tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7.c391e395-c36f-49ca-9ccf-6f954335bb97" returned: 0 in 0.646s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:56 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-cf862b06-585a-49ff-aadc-4149055ced7f tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-c391e395-c36f-49ca-9ccf-6f954335bb97" released by "_delete_snapshot" :: held 3.043s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:56 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-cf862b06-585a-49ff-aadc-4149055ced7f tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-001a3fff-2192-4474-a9d3-d4a477ae57a7" released by "delete_snapshot" :: held 3.065s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:56 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-cf862b06-585a-49ff-aadc-4149055ced7f tempest-ProjectMemberTests-1755578239 None] Created reservations ['0d5fa202-3692-48d7-b7b0-40cc490aefc8', 'f7bfd107-3083-4af4-8cc6-00a3ce6e43ef', '196cc022-a660-42a3-91c5-4cbabd8cd710', '1f6f384a-bdb4-4fb2-9fd4-84d042de75b9'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:47:56 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-cf862b06-585a-49ff-aadc-4149055ced7f tempest-ProjectMemberTests-1755578239 None] Delete snapshot completed successfully. Jul 10 00:47:56 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-cf862b06-585a-49ff-aadc-4149055ced7f tempest-ProjectMemberTests-1755578239 None] Lock "cinder-c391e395-c36f-49ca-9ccf-6f954335bb97-delete_snapshot" released by "delete_snapshot" :: held 3.214s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:56 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3b2a2cb2-43d0-4a6d-a35f-9eb6b7b12bdc tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.d734931a-b842-4690-8e65-5ffd6e20bfac" returned: 0 in 0.694s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:56 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-3b2a2cb2-43d0-4a6d-a35f-9eb6b7b12bdc tempest-ProjectReaderTests-619335768 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.d734931a-b842-4690-8e65-5ffd6e20bfac is being set with open permissions: ugo+rw Jul 10 00:47:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3b2a2cb2-43d0-4a6d-a35f-9eb6b7b12bdc tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.d734931a-b842-4690-8e65-5ffd6e20bfac {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:56 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.d734931a-b842-4690-8e65-5ffd6e20bfac Jul 10 00:47:56 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:57 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3b2a2cb2-43d0-4a6d-a35f-9eb6b7b12bdc tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.d734931a-b842-4690-8e65-5ffd6e20bfac" returned: 0 in 0.606s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3b2a2cb2-43d0-4a6d-a35f-9eb6b7b12bdc tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:57 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.info Jul 10 00:47:57 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:57 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-05b54588-d98f-4b78-9247-9c115b18b6c4 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-001a3fff-2192-4474-a9d3-d4a477ae57a7-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:57 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-05b54588-d98f-4b78-9247-9c115b18b6c4 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-001a3fff-2192-4474-a9d3-d4a477ae57a7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:57 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-05b54588-d98f-4b78-9247-9c115b18b6c4 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-001a3fff-2192-4474-a9d3-d4a477ae57a7" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:57 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-05b54588-d98f-4b78-9247-9c115b18b6c4 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-001a3fff-2192-4474-a9d3-d4a477ae57a7" acquired by "delete_volume" :: waited 0.017s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:57 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9058db-915e-4010-898c-e3d9cea03ae2]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-05b54588-d98f-4b78-9247-9c115b18b6c4 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:57 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7 Jul 10 00:47:57 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:57 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3b2a2cb2-43d0-4a6d-a35f-9eb6b7b12bdc tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.info" returned: 0 in 0.665s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:57 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-3b2a2cb2-43d0-4a6d-a35f-9eb6b7b12bdc tempest-ProjectReaderTests-619335768 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.info is being set with open permissions: ugo+rw Jul 10 00:47:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3b2a2cb2-43d0-4a6d-a35f-9eb6b7b12bdc tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:57 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.info Jul 10 00:47:57 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:58 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-05b54588-d98f-4b78-9247-9c115b18b6c4 tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7" returned: 0 in 0.737s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-05b54588-d98f-4b78-9247-9c115b18b6c4 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:58 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7 Jul 10 00:47:58 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:58 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-3b2a2cb2-43d0-4a6d-a35f-9eb6b7b12bdc tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.info" returned: 0 in 0.647s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-3b2a2cb2-43d0-4a6d-a35f-9eb6b7b12bdc tempest-ProjectReaderTests-619335768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.212s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:58 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-3b2a2cb2-43d0-4a6d-a35f-9eb6b7b12bdc tempest-ProjectReaderTests-619335768 None] Create snapshot completed successfully Jul 10 00:47:58 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-05b54588-d98f-4b78-9247-9c115b18b6c4 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-001a3fff-2192-4474-a9d3-d4a477ae57a7" returned: 0 in 0.640s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:58 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-05b54588-d98f-4b78-9247-9c115b18b6c4 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-001a3fff-2192-4474-a9d3-d4a477ae57a7" released by "delete_volume" :: held 1.432s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:47:58 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-05b54588-d98f-4b78-9247-9c115b18b6c4 tempest-ProjectMemberTests-1755578239 None] Created reservations ['8ee57002-1028-4cff-b81c-0149dea8dede', 'a8f401ec-61b6-4c86-9454-86d36a320443', '7967b459-df35-4863-8c74-1518903af363', '93d7baa0-ac01-428b-8b8b-120d7c449076'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:47:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-05b54588-d98f-4b78-9247-9c115b18b6c4 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:47:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-05b54588-d98f-4b78-9247-9c115b18b6c4 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:47:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-05b54588-d98f-4b78-9247-9c115b18b6c4 tempest-ProjectMemberTests-1755578239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:47:59 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-05b54588-d98f-4b78-9247-9c115b18b6c4 tempest-ProjectMemberTests-1755578239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:47:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-05b54588-d98f-4b78-9247-9c115b18b6c4 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:47:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-05b54588-d98f-4b78-9247-9c115b18b6c4 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:59 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:47:59 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-eba63997-cf1a-4a1b-aebf-febab4794678 tempest-ProjectReaderTests-619335768 None] Acquiring lock "cinder-d734931a-b842-4690-8e65-5ffd6e20bfac-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-eba63997-cf1a-4a1b-aebf-febab4794678 tempest-ProjectReaderTests-619335768 None] Lock "cinder-d734931a-b842-4690-8e65-5ffd6e20bfac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-eba63997-cf1a-4a1b-aebf-febab4794678 tempest-ProjectReaderTests-619335768 None] Acquiring lock "cinder-quobyte-6495f4c0-1876-4ede-8ea4-ddb4cc8600de" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-eba63997-cf1a-4a1b-aebf-febab4794678 tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-6495f4c0-1876-4ede-8ea4-ddb4cc8600de" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-eba63997-cf1a-4a1b-aebf-febab4794678 tempest-ProjectReaderTests-619335768 None] Acquiring lock "cinder-quobyte-d734931a-b842-4690-8e65-5ffd6e20bfac" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:47:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-eba63997-cf1a-4a1b-aebf-febab4794678 tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-d734931a-b842-4690-8e65-5ffd6e20bfac" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:47:59 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-eba63997-cf1a-4a1b-aebf-febab4794678 tempest-ProjectReaderTests-619335768 None] Deleting offline snapshot d734931a-b842-4690-8e65-5ffd6e20bfac of volume 6495f4c0-1876-4ede-8ea4-ddb4cc8600de {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:47:59 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-eba63997-cf1a-4a1b-aebf-febab4794678 tempest-ProjectReaderTests-619335768 None] snapshot_file for this snap is: volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.d734931a-b842-4690-8e65-5ffd6e20bfac {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:47:59 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34dfd33-53a8-4bb8-a21d-a8c6b20a980c]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:47:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eba63997-cf1a-4a1b-aebf-febab4794678 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.d734931a-b842-4690-8e65-5ffd6e20bfac {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:47:59 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Jul 10 00:47:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-05b54588-d98f-4b78-9247-9c115b18b6c4 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.671s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:47:59 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-05b54588-d98f-4b78-9247-9c115b18b6c4 tempest-ProjectMemberTests-1755578239 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:47:59 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-05b54588-d98f-4b78-9247-9c115b18b6c4 tempest-ProjectMemberTests-1755578239 None] Deleted volume successfully. Jul 10 00:47:59 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.d734931a-b842-4690-8e65-5ffd6e20bfac Jul 10 00:47:59 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:47:59 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-05b54588-d98f-4b78-9247-9c115b18b6c4 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-001a3fff-2192-4474-a9d3-d4a477ae57a7-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:00 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:48:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Flow 'volume_create_manager' (7cf95a32-25dd-402f-ba74-62b3a105f4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:48:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0540f135-e8ea-4c48-be84-7da9a3f49974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0540f135-e8ea-4c48-be84-7da9a3f49974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1330261572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd304609-3b38-481e-b044-b3b3f30b5244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f238e094d83c41769907fe7fe98cb92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:48:00Z,use_quota=True,user_id='6ae3ebc77379400a81756522642f35cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e3aff09-3b7c-4723-bd41-e07823540222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e3aff09-3b7c-4723-bd41-e07823540222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae95dfd-ffad-4efc-a72e-fb61d54aed77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae95dfd-ffad-4efc-a72e-fb61d54aed77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd304609-3b38-481e-b044-b3b3f30b5244', 'volume_name': 'volume-fd304609-3b38-481e-b044-b3b3f30b5244', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0369e03-12a2-4db5-8be0-103ed08289bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0369e03-12a2-4db5-8be0-103ed08289bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:00 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf6eb94-d8f4-42b4-b547-afcb716a5fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:00 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Volume fd304609-3b38-481e-b044-b3b3f30b5244: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd304609-3b38-481e-b044-b3b3f30b5244', 'volume_size': 1} Jul 10 00:48:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:48:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1330261572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd304609-3b38-481e-b044-b3b3f30b5244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f238e094d83c41769907fe7fe98cb92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:48:00Z,use_quota=True,user_id='6ae3ebc77379400a81756522642f35cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:48:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Creating volume fd304609-3b38-481e-b044-b3b3f30b5244 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:48:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:48:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:48:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:48:00 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:48:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:00 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244 1073741824 Jul 10 00:48:00 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:00 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eba63997-cf1a-4a1b-aebf-febab4794678 tempest-ProjectReaderTests-619335768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.d734931a-b842-4690-8e65-5ffd6e20bfac" returned: 0 in 0.776s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:00 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-eba63997-cf1a-4a1b-aebf-febab4794678 tempest-ProjectReaderTests-619335768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:48:00 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78f45d7-9c7c-4418-b0a1-d35c4bdee886]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eba63997-cf1a-4a1b-aebf-febab4794678 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:00 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de Jul 10 00:48:00 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:01 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244 1073741824" returned: 0 in 0.846s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:01 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244 Jul 10 00:48:01 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:01 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eba63997-cf1a-4a1b-aebf-febab4794678 tempest-ProjectReaderTests-619335768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de" returned: 0 in 0.772s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eba63997-cf1a-4a1b-aebf-febab4794678 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.d734931a-b842-4690-8e65-5ffd6e20bfac {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:01 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.d734931a-b842-4690-8e65-5ffd6e20bfac Jul 10 00:48:01 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:01 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244" returned: 0 in 0.640s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:01 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:48:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:01 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf6eb94-d8f4-42b4-b547-afcb716a5fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd304609-3b38-481e-b044-b3b3f30b5244', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:01 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c082c3ee-ba4d-4efb-b4a6-8fcc551dc581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:01 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Volume volume-fd304609-3b38-481e-b044-b3b3f30b5244 (fd304609-3b38-481e-b044-b3b3f30b5244): created successfully Jul 10 00:48:01 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c082c3ee-ba4d-4efb-b4a6-8fcc551dc581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:01 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Flow 'volume_create_manager' (7cf95a32-25dd-402f-ba74-62b3a105f4d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:48:01 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-66a15a62-c006-4a22-896f-438974c188f3 tempest-ProjectMemberTests-1755578239 None] Created volume successfully. Jul 10 00:48:01 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eba63997-cf1a-4a1b-aebf-febab4794678 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.d734931a-b842-4690-8e65-5ffd6e20bfac" returned: 0 in 0.741s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eba63997-cf1a-4a1b-aebf-febab4794678 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.d734931a-b842-4690-8e65-5ffd6e20bfac {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:01 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.d734931a-b842-4690-8e65-5ffd6e20bfac Jul 10 00:48:01 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-69083cb1-f9c5-4cf8-aa55-a47f12c3e51a tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-69083cb1-f9c5-4cf8-aa55-a47f12c3e51a tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:02 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-69083cb1-f9c5-4cf8-aa55-a47f12c3e51a tempest-ProjectMemberTests-1755578239 None] Creating offline snapshot abcf9baf-653b-48ae-992c-784b04c630bd of volume fd304609-3b38-481e-b044-b3b3f30b5244 {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:48:02 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[214a7e48-f1a5-4de3-a97f-7c7fc54e2a8e]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-69083cb1-f9c5-4cf8-aa55-a47f12c3e51a tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:02 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244 Jul 10 00:48:02 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:02 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-eba63997-cf1a-4a1b-aebf-febab4794678 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de.d734931a-b842-4690-8e65-5ffd6e20bfac" returned: 0 in 0.637s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-eba63997-cf1a-4a1b-aebf-febab4794678 tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-d734931a-b842-4690-8e65-5ffd6e20bfac" released by "_delete_snapshot" :: held 3.039s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-eba63997-cf1a-4a1b-aebf-febab4794678 tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-6495f4c0-1876-4ede-8ea4-ddb4cc8600de" released by "delete_snapshot" :: held 3.062s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:02 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-eba63997-cf1a-4a1b-aebf-febab4794678 tempest-ProjectReaderTests-619335768 None] Created reservations ['36d694d3-a0d4-453b-8162-bae8ba7393ff', 'bf2770e5-8d5e-473e-8895-5310bfac7065', '4d1ec856-fed0-4b0b-aa7e-3b175be13a84', '5ad7eeaf-519c-46c8-85f5-42bc18d91608'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:48:02 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-eba63997-cf1a-4a1b-aebf-febab4794678 tempest-ProjectReaderTests-619335768 None] Delete snapshot completed successfully. Jul 10 00:48:02 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-eba63997-cf1a-4a1b-aebf-febab4794678 tempest-ProjectReaderTests-619335768 None] Lock "cinder-d734931a-b842-4690-8e65-5ffd6e20bfac-delete_snapshot" released by "delete_snapshot" :: held 3.212s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:03 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-69083cb1-f9c5-4cf8-aa55-a47f12c3e51a tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244" returned: 0 in 0.772s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-69083cb1-f9c5-4cf8-aa55-a47f12c3e51a tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244.abcf9baf-653b-48ae-992c-784b04c630bd 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:03 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244.abcf9baf-653b-48ae-992c-784b04c630bd 1G Jul 10 00:48:03 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:03 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-5a9f94e6-bbc1-4141-8c74-c7a88e9747e6 tempest-ProjectReaderTests-619335768 None] Acquiring lock "cinder-6495f4c0-1876-4ede-8ea4-ddb4cc8600de-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:03 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-5a9f94e6-bbc1-4141-8c74-c7a88e9747e6 tempest-ProjectReaderTests-619335768 None] Lock "cinder-6495f4c0-1876-4ede-8ea4-ddb4cc8600de-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:03 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-5a9f94e6-bbc1-4141-8c74-c7a88e9747e6 tempest-ProjectReaderTests-619335768 None] Acquiring lock "cinder-quobyte-6495f4c0-1876-4ede-8ea4-ddb4cc8600de" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:03 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-5a9f94e6-bbc1-4141-8c74-c7a88e9747e6 tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-6495f4c0-1876-4ede-8ea4-ddb4cc8600de" acquired by "delete_volume" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:03 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bbfc6b-4536-46ba-9be1-6b3e0260027f]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5a9f94e6-bbc1-4141-8c74-c7a88e9747e6 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:03 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de Jul 10 00:48:03 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:03 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-69083cb1-f9c5-4cf8-aa55-a47f12c3e51a tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244.abcf9baf-653b-48ae-992c-784b04c630bd 1G" returned: 0 in 0.827s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-69083cb1-f9c5-4cf8-aa55-a47f12c3e51a tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd304609-3b38-481e-b044-b3b3f30b5244 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244.abcf9baf-653b-48ae-992c-784b04c630bd {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:04 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd304609-3b38-481e-b044-b3b3f30b5244 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244.abcf9baf-653b-48ae-992c-784b04c630bd Jul 10 00:48:04 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:04 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5a9f94e6-bbc1-4141-8c74-c7a88e9747e6 tempest-ProjectReaderTests-619335768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de" returned: 0 in 0.768s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5a9f94e6-bbc1-4141-8c74-c7a88e9747e6 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:04 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de Jul 10 00:48:04 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:04 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-69083cb1-f9c5-4cf8-aa55-a47f12c3e51a tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd304609-3b38-481e-b044-b3b3f30b5244 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244.abcf9baf-653b-48ae-992c-784b04c630bd" returned: 0 in 0.686s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:04 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-69083cb1-f9c5-4cf8-aa55-a47f12c3e51a tempest-ProjectMemberTests-1755578239 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244.abcf9baf-653b-48ae-992c-784b04c630bd is being set with open permissions: ugo+rw Jul 10 00:48:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-69083cb1-f9c5-4cf8-aa55-a47f12c3e51a tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244.abcf9baf-653b-48ae-992c-784b04c630bd {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:04 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244.abcf9baf-653b-48ae-992c-784b04c630bd Jul 10 00:48:04 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:05 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5a9f94e6-bbc1-4141-8c74-c7a88e9747e6 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-6495f4c0-1876-4ede-8ea4-ddb4cc8600de" returned: 0 in 0.630s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:05 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-5a9f94e6-bbc1-4141-8c74-c7a88e9747e6 tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-6495f4c0-1876-4ede-8ea4-ddb4cc8600de" released by "delete_volume" :: held 1.454s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:05 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-69083cb1-f9c5-4cf8-aa55-a47f12c3e51a tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244.abcf9baf-653b-48ae-992c-784b04c630bd" returned: 0 in 0.617s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:05 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-5a9f94e6-bbc1-4141-8c74-c7a88e9747e6 tempest-ProjectReaderTests-619335768 None] Created reservations ['fce35cae-0c7c-46dd-8b54-e4472643f698', '14b5ee5b-9c74-4640-86c5-4c9d4dc11227', 'e85c0bd8-d872-4123-9481-8eec9b7d7c18', '1d3bb120-dd5a-48ac-82e0-cfa9bac5d6d5'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:48:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-69083cb1-f9c5-4cf8-aa55-a47f12c3e51a tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:05 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244.info Jul 10 00:48:05 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5a9f94e6-bbc1-4141-8c74-c7a88e9747e6 tempest-ProjectReaderTests-619335768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5a9f94e6-bbc1-4141-8c74-c7a88e9747e6 tempest-ProjectReaderTests-619335768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5a9f94e6-bbc1-4141-8c74-c7a88e9747e6 tempest-ProjectReaderTests-619335768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:48:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-5a9f94e6-bbc1-4141-8c74-c7a88e9747e6 tempest-ProjectReaderTests-619335768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:48:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5a9f94e6-bbc1-4141-8c74-c7a88e9747e6 tempest-ProjectReaderTests-619335768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5a9f94e6-bbc1-4141-8c74-c7a88e9747e6 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:05 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:48:05 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:06 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-69083cb1-f9c5-4cf8-aa55-a47f12c3e51a tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244.info" returned: 0 in 0.704s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:06 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-69083cb1-f9c5-4cf8-aa55-a47f12c3e51a tempest-ProjectMemberTests-1755578239 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244.info is being set with open permissions: ugo+rw Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-69083cb1-f9c5-4cf8-aa55-a47f12c3e51a tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:06 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244.info Jul 10 00:48:06 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:06 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5a9f94e6-bbc1-4141-8c74-c7a88e9747e6 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.711s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-5a9f94e6-bbc1-4141-8c74-c7a88e9747e6 tempest-ProjectReaderTests-619335768 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:48:06 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-5a9f94e6-bbc1-4141-8c74-c7a88e9747e6 tempest-ProjectReaderTests-619335768 None] Deleted volume successfully. Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-5a9f94e6-bbc1-4141-8c74-c7a88e9747e6 tempest-ProjectReaderTests-619335768 None] Lock "cinder-6495f4c0-1876-4ede-8ea4-ddb4cc8600de-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Flow 'volume_create_manager' (b29714c8-aac2-4e11-8f0b-6705fb508e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6fde5e-87ed-4fe2-805c-51129e4fb3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6fde5e-87ed-4fe2-805c-51129e4fb3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-372620215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ea29ee052f4b8aac142f6ce2eb3d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:48:06Z,use_quota=True,user_id='9c4f444d003740afbc235bc3741be420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69fd8e3-28ae-4268-a47c-29b38003558c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69fd8e3-28ae-4268-a47c-29b38003558c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e332c35a-694e-4967-8cc1-ec86d752822b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e332c35a-694e-4967-8cc1-ec86d752822b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b', 'volume_name': 'volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd1b2a2-3eee-4cf4-9559-13f6d4803379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbd1b2a2-3eee-4cf4-9559-13f6d4803379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa5cfe8-84a9-4059-b9ac-288e793b2d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:06 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Volume 7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b', 'volume_size': 1} Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:06 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-69083cb1-f9c5-4cf8-aa55-a47f12c3e51a tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244.info" returned: 0 in 0.652s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-69083cb1-f9c5-4cf8-aa55-a47f12c3e51a tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.355s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.216s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-372620215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ea29ee052f4b8aac142f6ce2eb3d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:48:06Z,use_quota=True,user_id='9c4f444d003740afbc235bc3741be420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Creating volume 7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:48:06 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:48:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:06 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b 1073741824 Jul 10 00:48:06 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:06 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-69083cb1-f9c5-4cf8-aa55-a47f12c3e51a tempest-ProjectMemberTests-1755578239 None] Create snapshot completed successfully Jul 10 00:48:07 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b 1073741824" returned: 0 in 0.778s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:07 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b Jul 10 00:48:07 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-61441304-394d-4356-9579-58640b6067d0 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-abcf9baf-653b-48ae-992c-784b04c630bd-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-61441304-394d-4356-9579-58640b6067d0 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-abcf9baf-653b-48ae-992c-784b04c630bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-61441304-394d-4356-9579-58640b6067d0 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-fd304609-3b38-481e-b044-b3b3f30b5244" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-61441304-394d-4356-9579-58640b6067d0 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-fd304609-3b38-481e-b044-b3b3f30b5244" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-61441304-394d-4356-9579-58640b6067d0 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-abcf9baf-653b-48ae-992c-784b04c630bd" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-61441304-394d-4356-9579-58640b6067d0 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-abcf9baf-653b-48ae-992c-784b04c630bd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-61441304-394d-4356-9579-58640b6067d0 tempest-ProjectMemberTests-1755578239 None] Deleting offline snapshot abcf9baf-653b-48ae-992c-784b04c630bd of volume fd304609-3b38-481e-b044-b3b3f30b5244 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:48:07 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-61441304-394d-4356-9579-58640b6067d0 tempest-ProjectMemberTests-1755578239 None] snapshot_file for this snap is: volume-fd304609-3b38-481e-b044-b3b3f30b5244.abcf9baf-653b-48ae-992c-784b04c630bd {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:48:07 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[93544103-68be-43fd-a57f-b10a22a7441b]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-61441304-394d-4356-9579-58640b6067d0 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244.abcf9baf-653b-48ae-992c-784b04c630bd {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:07 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244.abcf9baf-653b-48ae-992c-784b04c630bd Jul 10 00:48:07 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:08 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b" returned: 0 in 0.639s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:48:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa5cfe8-84a9-4059-b9ac-288e793b2d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2b4bb0-2032-4851-a7b4-4eb9ba36b256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:08 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Volume volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b (7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b): created successfully Jul 10 00:48:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2b4bb0-2032-4851-a7b4-4eb9ba36b256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:08 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Flow 'volume_create_manager' (b29714c8-aac2-4e11-8f0b-6705fb508e70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:48:08 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-f3131b2e-7f11-4c85-8d28-8ecbf0a91335 tempest-ProjectReaderTests-619335768 None] Created volume successfully. Jul 10 00:48:08 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-61441304-394d-4356-9579-58640b6067d0 tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244.abcf9baf-653b-48ae-992c-784b04c630bd" returned: 0 in 0.799s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-61441304-394d-4356-9579-58640b6067d0 tempest-ProjectMemberTests-1755578239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd304609-3b38-481e-b044-b3b3f30b5244(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:48:08 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fc91d7-e852-4f99-8c37-edf61a257e97]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-61441304-394d-4356-9579-58640b6067d0 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:08 devstack sudo[108083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244 Jul 10 00:48:08 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2247f4aa-5eb7-47c1-8f1f-065d6dc4752b tempest-ProjectReaderTests-619335768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2247f4aa-5eb7-47c1-8f1f-065d6dc4752b tempest-ProjectReaderTests-619335768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:08 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-2247f4aa-5eb7-47c1-8f1f-065d6dc4752b tempest-ProjectReaderTests-619335768 None] Creating offline snapshot 8c87bb71-b1a3-4591-b256-81b8d933e6ba of volume 7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:48:08 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fd751a-ef92-4d29-a86f-21a051c06e60]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2247f4aa-5eb7-47c1-8f1f-065d6dc4752b tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:08 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b Jul 10 00:48:08 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:09 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-61441304-394d-4356-9579-58640b6067d0 tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244" returned: 0 in 0.751s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-61441304-394d-4356-9579-58640b6067d0 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244.abcf9baf-653b-48ae-992c-784b04c630bd {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:09 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244.abcf9baf-653b-48ae-992c-784b04c630bd Jul 10 00:48:09 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:09 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2247f4aa-5eb7-47c1-8f1f-065d6dc4752b tempest-ProjectReaderTests-619335768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b" returned: 0 in 0.751s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2247f4aa-5eb7-47c1-8f1f-065d6dc4752b tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.8c87bb71-b1a3-4591-b256-81b8d933e6ba 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:09 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.8c87bb71-b1a3-4591-b256-81b8d933e6ba 1G Jul 10 00:48:09 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:09 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-61441304-394d-4356-9579-58640b6067d0 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244.abcf9baf-653b-48ae-992c-784b04c630bd" returned: 0 in 0.725s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-61441304-394d-4356-9579-58640b6067d0 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244.abcf9baf-653b-48ae-992c-784b04c630bd {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:10 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244.abcf9baf-653b-48ae-992c-784b04c630bd Jul 10 00:48:10 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:10 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2247f4aa-5eb7-47c1-8f1f-065d6dc4752b tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.8c87bb71-b1a3-4591-b256-81b8d933e6ba 1G" returned: 0 in 0.806s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2247f4aa-5eb7-47c1-8f1f-065d6dc4752b tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.8c87bb71-b1a3-4591-b256-81b8d933e6ba {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:10 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.8c87bb71-b1a3-4591-b256-81b8d933e6ba Jul 10 00:48:10 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:10 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-61441304-394d-4356-9579-58640b6067d0 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244.abcf9baf-653b-48ae-992c-784b04c630bd" returned: 0 in 0.712s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:10 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-61441304-394d-4356-9579-58640b6067d0 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-abcf9baf-653b-48ae-992c-784b04c630bd" released by "_delete_snapshot" :: held 3.095s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:10 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-61441304-394d-4356-9579-58640b6067d0 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-fd304609-3b38-481e-b044-b3b3f30b5244" released by "delete_snapshot" :: held 3.117s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:10 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-61441304-394d-4356-9579-58640b6067d0 tempest-ProjectMemberTests-1755578239 None] Created reservations ['d2e2c52f-d09e-4d7e-a2fe-85aa22f64ed3', '59b00ef2-0c0e-46a4-91f4-ff67ad9e5887', '4375a7e6-7d36-4d76-a3ec-fcf9521e2520', '2f53fc40-085e-4caa-9c49-da1679b1eeda'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:48:10 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-61441304-394d-4356-9579-58640b6067d0 tempest-ProjectMemberTests-1755578239 None] Delete snapshot completed successfully. Jul 10 00:48:10 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-61441304-394d-4356-9579-58640b6067d0 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-abcf9baf-653b-48ae-992c-784b04c630bd-delete_snapshot" released by "delete_snapshot" :: held 3.258s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:10 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2247f4aa-5eb7-47c1-8f1f-065d6dc4752b tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.8c87bb71-b1a3-4591-b256-81b8d933e6ba" returned: 0 in 0.727s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:10 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-2247f4aa-5eb7-47c1-8f1f-065d6dc4752b tempest-ProjectReaderTests-619335768 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.8c87bb71-b1a3-4591-b256-81b8d933e6ba is being set with open permissions: ugo+rw Jul 10 00:48:10 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2247f4aa-5eb7-47c1-8f1f-065d6dc4752b tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.8c87bb71-b1a3-4591-b256-81b8d933e6ba {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:11 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.8c87bb71-b1a3-4591-b256-81b8d933e6ba Jul 10 00:48:11 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:11 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2247f4aa-5eb7-47c1-8f1f-065d6dc4752b tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.8c87bb71-b1a3-4591-b256-81b8d933e6ba" returned: 0 in 0.613s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2247f4aa-5eb7-47c1-8f1f-065d6dc4752b tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:11 devstack sudo[108114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.info Jul 10 00:48:11 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-72634aec-3577-4d35-911d-4fb84dae333d tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-fd304609-3b38-481e-b044-b3b3f30b5244-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-72634aec-3577-4d35-911d-4fb84dae333d tempest-ProjectMemberTests-1755578239 None] Lock "cinder-fd304609-3b38-481e-b044-b3b3f30b5244-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-72634aec-3577-4d35-911d-4fb84dae333d tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-fd304609-3b38-481e-b044-b3b3f30b5244" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:11 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-72634aec-3577-4d35-911d-4fb84dae333d tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-fd304609-3b38-481e-b044-b3b3f30b5244" acquired by "delete_volume" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:11 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd3b80f-881b-4ace-942e-caa53a981533]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:11 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-72634aec-3577-4d35-911d-4fb84dae333d tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:12 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244 Jul 10 00:48:12 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:12 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2247f4aa-5eb7-47c1-8f1f-065d6dc4752b tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.info" returned: 0 in 0.661s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:12 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-2247f4aa-5eb7-47c1-8f1f-065d6dc4752b tempest-ProjectReaderTests-619335768 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.info is being set with open permissions: ugo+rw Jul 10 00:48:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2247f4aa-5eb7-47c1-8f1f-065d6dc4752b tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:12 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.info Jul 10 00:48:12 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:12 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-72634aec-3577-4d35-911d-4fb84dae333d tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244" returned: 0 in 0.771s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-72634aec-3577-4d35-911d-4fb84dae333d tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:12 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244 Jul 10 00:48:12 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:12 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2247f4aa-5eb7-47c1-8f1f-065d6dc4752b tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.info" returned: 0 in 0.642s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:12 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2247f4aa-5eb7-47c1-8f1f-065d6dc4752b tempest-ProjectReaderTests-619335768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.287s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:12 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-2247f4aa-5eb7-47c1-8f1f-065d6dc4752b tempest-ProjectReaderTests-619335768 None] Create snapshot completed successfully Jul 10 00:48:13 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-72634aec-3577-4d35-911d-4fb84dae333d tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-fd304609-3b38-481e-b044-b3b3f30b5244" returned: 0 in 0.634s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:13 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-72634aec-3577-4d35-911d-4fb84dae333d tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-fd304609-3b38-481e-b044-b3b3f30b5244" released by "delete_volume" :: held 1.458s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:13 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-72634aec-3577-4d35-911d-4fb84dae333d tempest-ProjectMemberTests-1755578239 None] Created reservations ['6787c7e0-ac70-412f-abc3-4f05763e9d16', '6a5afdf0-0b67-44b5-b296-b0604ae078af', 'ceae2c32-66fc-49c7-9074-389b51efcf55', '336b9300-867d-4b53-abfe-d16af626935e'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:48:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-72634aec-3577-4d35-911d-4fb84dae333d tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-72634aec-3577-4d35-911d-4fb84dae333d tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-72634aec-3577-4d35-911d-4fb84dae333d tempest-ProjectMemberTests-1755578239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:48:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-72634aec-3577-4d35-911d-4fb84dae333d tempest-ProjectMemberTests-1755578239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:48:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-72634aec-3577-4d35-911d-4fb84dae333d tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-72634aec-3577-4d35-911d-4fb84dae333d tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:13 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:48:13 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:13 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-be739c3c-5499-470f-b124-351d6f4afa55 tempest-ProjectReaderTests-619335768 None] Acquiring lock "cinder-8c87bb71-b1a3-4591-b256-81b8d933e6ba-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:13 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-be739c3c-5499-470f-b124-351d6f4afa55 tempest-ProjectReaderTests-619335768 None] Lock "cinder-8c87bb71-b1a3-4591-b256-81b8d933e6ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:13 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-be739c3c-5499-470f-b124-351d6f4afa55 tempest-ProjectReaderTests-619335768 None] Acquiring lock "cinder-quobyte-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:13 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-be739c3c-5499-470f-b124-351d6f4afa55 tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:13 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-be739c3c-5499-470f-b124-351d6f4afa55 tempest-ProjectReaderTests-619335768 None] Acquiring lock "cinder-quobyte-8c87bb71-b1a3-4591-b256-81b8d933e6ba" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:13 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-be739c3c-5499-470f-b124-351d6f4afa55 tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-8c87bb71-b1a3-4591-b256-81b8d933e6ba" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-be739c3c-5499-470f-b124-351d6f4afa55 tempest-ProjectReaderTests-619335768 None] Deleting offline snapshot 8c87bb71-b1a3-4591-b256-81b8d933e6ba of volume 7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:48:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-be739c3c-5499-470f-b124-351d6f4afa55 tempest-ProjectReaderTests-619335768 None] snapshot_file for this snap is: volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.8c87bb71-b1a3-4591-b256-81b8d933e6ba {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:48:13 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dfde33-842c-4b76-a157-13a627df9dd4]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-be739c3c-5499-470f-b124-351d6f4afa55 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.8c87bb71-b1a3-4591-b256-81b8d933e6ba {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:14 devstack sudo[108130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.8c87bb71-b1a3-4591-b256-81b8d933e6ba Jul 10 00:48:14 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:14 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-72634aec-3577-4d35-911d-4fb84dae333d tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.671s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-72634aec-3577-4d35-911d-4fb84dae333d tempest-ProjectMemberTests-1755578239 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:48:14 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-72634aec-3577-4d35-911d-4fb84dae333d tempest-ProjectMemberTests-1755578239 None] Deleted volume successfully. Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-72634aec-3577-4d35-911d-4fb84dae333d tempest-ProjectMemberTests-1755578239 None] Lock "cinder-fd304609-3b38-481e-b044-b3b3f30b5244-delete_volume" released by "delete_volume" :: held 2.351s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Flow 'volume_create_manager' (2e2c1a82-eb75-40d0-9a73-0fd5dcc6f50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e460519e-d3b9-456e-9c2a-f355bd54af22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e460519e-d3b9-456e-9c2a-f355bd54af22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-144682048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1388f9e0-e8b6-4506-8e87-6d6faf387e4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f238e094d83c41769907fe7fe98cb92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:48:14Z,use_quota=True,user_id='6ae3ebc77379400a81756522642f35cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9354ebd-2b58-4c49-a0cb-9368d7b41483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9354ebd-2b58-4c49-a0cb-9368d7b41483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04facb52-24b8-49fe-b130-97f8aef15e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04facb52-24b8-49fe-b130-97f8aef15e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1388f9e0-e8b6-4506-8e87-6d6faf387e4a', 'volume_name': 'volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f3f4b7a-2bb2-4d13-9084-f990fd03ad59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f3f4b7a-2bb2-4d13-9084-f990fd03ad59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b249d9d-2d90-48fe-a25a-c224fc30c754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:14 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Volume 1388f9e0-e8b6-4506-8e87-6d6faf387e4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a', 'volume_size': 1} Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-144682048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1388f9e0-e8b6-4506-8e87-6d6faf387e4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f238e094d83c41769907fe7fe98cb92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:48:14Z,use_quota=True,user_id='6ae3ebc77379400a81756522642f35cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Creating volume 1388f9e0-e8b6-4506-8e87-6d6faf387e4a {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:48:14 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:14 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a 1073741824 Jul 10 00:48:14 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:14 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-be739c3c-5499-470f-b124-351d6f4afa55 tempest-ProjectReaderTests-619335768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.8c87bb71-b1a3-4591-b256-81b8d933e6ba" returned: 0 in 0.779s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-be739c3c-5499-470f-b124-351d6f4afa55 tempest-ProjectReaderTests-619335768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1bde58-0452-4df1-ac17-e3a2f6758891]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-be739c3c-5499-470f-b124-351d6f4afa55 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:14 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b Jul 10 00:48:14 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:15 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a 1073741824" returned: 0 in 0.835s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:15 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a Jul 10 00:48:15 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:15 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-be739c3c-5499-470f-b124-351d6f4afa55 tempest-ProjectReaderTests-619335768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b" returned: 0 in 0.801s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-be739c3c-5499-470f-b124-351d6f4afa55 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.8c87bb71-b1a3-4591-b256-81b8d933e6ba {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:15 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.8c87bb71-b1a3-4591-b256-81b8d933e6ba Jul 10 00:48:15 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:16 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a" returned: 0 in 0.657s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:16 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:48:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b249d9d-2d90-48fe-a25a-c224fc30c754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728f6e13-17cd-4859-a074-2d710b8a83d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:16 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Volume volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a (1388f9e0-e8b6-4506-8e87-6d6faf387e4a): created successfully Jul 10 00:48:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (728f6e13-17cd-4859-a074-2d710b8a83d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:16 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Flow 'volume_create_manager' (2e2c1a82-eb75-40d0-9a73-0fd5dcc6f50a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:48:16 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-7b32411d-d160-404d-bac6-eccab1ec156f tempest-ProjectMemberTests-1755578239 None] Created volume successfully. Jul 10 00:48:16 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-be739c3c-5499-470f-b124-351d6f4afa55 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.8c87bb71-b1a3-4591-b256-81b8d933e6ba" returned: 0 in 0.749s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-be739c3c-5499-470f-b124-351d6f4afa55 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.8c87bb71-b1a3-4591-b256-81b8d933e6ba {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:16 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.8c87bb71-b1a3-4591-b256-81b8d933e6ba Jul 10 00:48:16 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5d6470e2-3a2a-4175-a274-849595324834 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5d6470e2-3a2a-4175-a274-849595324834 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:16 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-5d6470e2-3a2a-4175-a274-849595324834 tempest-ProjectMemberTests-1755578239 None] Creating offline snapshot eb5e6e49-74d6-4851-98d5-0fb6c62bd422 of volume 1388f9e0-e8b6-4506-8e87-6d6faf387e4a {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:48:16 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[38867c42-d5e0-4be7-a33e-9818f8d2bb11]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5d6470e2-3a2a-4175-a274-849595324834 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:16 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a Jul 10 00:48:16 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:17 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-be739c3c-5499-470f-b124-351d6f4afa55 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b.8c87bb71-b1a3-4591-b256-81b8d933e6ba" returned: 0 in 0.703s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:17 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-be739c3c-5499-470f-b124-351d6f4afa55 tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-8c87bb71-b1a3-4591-b256-81b8d933e6ba" released by "_delete_snapshot" :: held 3.146s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:17 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-be739c3c-5499-470f-b124-351d6f4afa55 tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b" released by "delete_snapshot" :: held 3.168s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:17 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-be739c3c-5499-470f-b124-351d6f4afa55 tempest-ProjectReaderTests-619335768 None] Created reservations ['2dcaf57d-b7f6-4bdf-8e6e-e8c6f3dd894e', '0c9b7f7a-80f0-4d3d-85da-04d421848e15', '360edcb5-8417-49aa-94bb-f76d01ad10da', 'cc6ddec4-2f74-4861-836a-10b4edc6571f'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:48:17 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-be739c3c-5499-470f-b124-351d6f4afa55 tempest-ProjectReaderTests-619335768 None] Delete snapshot completed successfully. Jul 10 00:48:17 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-be739c3c-5499-470f-b124-351d6f4afa55 tempest-ProjectReaderTests-619335768 None] Lock "cinder-8c87bb71-b1a3-4591-b256-81b8d933e6ba-delete_snapshot" released by "delete_snapshot" :: held 3.310s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:17 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5d6470e2-3a2a-4175-a274-849595324834 tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a" returned: 0 in 0.747s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5d6470e2-3a2a-4175-a274-849595324834 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.eb5e6e49-74d6-4851-98d5-0fb6c62bd422 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:17 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.eb5e6e49-74d6-4851-98d5-0fb6c62bd422 1G Jul 10 00:48:17 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:18 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a7d6a849-d705-48d2-a760-e326e2e493a8 tempest-ProjectReaderTests-619335768 None] Acquiring lock "cinder-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:18 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a7d6a849-d705-48d2-a760-e326e2e493a8 tempest-ProjectReaderTests-619335768 None] Lock "cinder-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:18 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a7d6a849-d705-48d2-a760-e326e2e493a8 tempest-ProjectReaderTests-619335768 None] Acquiring lock "cinder-quobyte-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:18 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a7d6a849-d705-48d2-a760-e326e2e493a8 tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b" acquired by "delete_volume" :: waited 0.013s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:18 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6541a722-1240-4b33-b7ef-ed14fd1a3046]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7d6a849-d705-48d2-a760-e326e2e493a8 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:18 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b Jul 10 00:48:18 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:18 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5d6470e2-3a2a-4175-a274-849595324834 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.eb5e6e49-74d6-4851-98d5-0fb6c62bd422 1G" returned: 0 in 0.789s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5d6470e2-3a2a-4175-a274-849595324834 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.eb5e6e49-74d6-4851-98d5-0fb6c62bd422 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:18 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.eb5e6e49-74d6-4851-98d5-0fb6c62bd422 Jul 10 00:48:18 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:18 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7d6a849-d705-48d2-a760-e326e2e493a8 tempest-ProjectReaderTests-619335768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b" returned: 0 in 0.756s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7d6a849-d705-48d2-a760-e326e2e493a8 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:19 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b Jul 10 00:48:19 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:19 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5d6470e2-3a2a-4175-a274-849595324834 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.eb5e6e49-74d6-4851-98d5-0fb6c62bd422" returned: 0 in 0.704s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:19 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-5d6470e2-3a2a-4175-a274-849595324834 tempest-ProjectMemberTests-1755578239 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.eb5e6e49-74d6-4851-98d5-0fb6c62bd422 is being set with open permissions: ugo+rw Jul 10 00:48:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5d6470e2-3a2a-4175-a274-849595324834 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.eb5e6e49-74d6-4851-98d5-0fb6c62bd422 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:19 devstack sudo[108180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.eb5e6e49-74d6-4851-98d5-0fb6c62bd422 Jul 10 00:48:19 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:19 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7d6a849-d705-48d2-a760-e326e2e493a8 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b" returned: 0 in 0.642s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:19 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a7d6a849-d705-48d2-a760-e326e2e493a8 tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b" released by "delete_volume" :: held 1.461s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:19 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-a7d6a849-d705-48d2-a760-e326e2e493a8 tempest-ProjectReaderTests-619335768 None] Created reservations ['8f076da1-5cb3-40c8-861c-c0a80c9ce0bc', '1d4c8068-233d-4d4b-921d-301b62b1d104', '9bd44a9b-b5b8-4628-87b8-3f19f3e6ce65', '5221561d-3b77-440e-a866-d5c8587b8179'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:48:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a7d6a849-d705-48d2-a760-e326e2e493a8 tempest-ProjectReaderTests-619335768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a7d6a849-d705-48d2-a760-e326e2e493a8 tempest-ProjectReaderTests-619335768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a7d6a849-d705-48d2-a760-e326e2e493a8 tempest-ProjectReaderTests-619335768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:48:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a7d6a849-d705-48d2-a760-e326e2e493a8 tempest-ProjectReaderTests-619335768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:48:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a7d6a849-d705-48d2-a760-e326e2e493a8 tempest-ProjectReaderTests-619335768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:19 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7d6a849-d705-48d2-a760-e326e2e493a8 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5d6470e2-3a2a-4175-a274-849595324834 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.eb5e6e49-74d6-4851-98d5-0fb6c62bd422" returned: 0 in 0.669s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:19 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=107,cinder:UPDATE=151,cinder:INSERT=48,cinder:DELETE=9 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:48:19 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:48:19 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5d6470e2-3a2a-4175-a274-849595324834 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:19 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.info Jul 10 00:48:19 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:20 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a7d6a849-d705-48d2-a760-e326e2e493a8 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.628s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:20 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-a7d6a849-d705-48d2-a760-e326e2e493a8 tempest-ProjectReaderTests-619335768 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:48:20 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-a7d6a849-d705-48d2-a760-e326e2e493a8 tempest-ProjectReaderTests-619335768 None] Deleted volume successfully. Jul 10 00:48:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a7d6a849-d705-48d2-a760-e326e2e493a8 tempest-ProjectReaderTests-619335768 None] Lock "cinder-7c3918c7-a5d7-44f5-8d97-ee28d0ba5a0b-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:20 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5d6470e2-3a2a-4175-a274-849595324834 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.info" returned: 0 in 0.690s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:20 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-5d6470e2-3a2a-4175-a274-849595324834 tempest-ProjectMemberTests-1755578239 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.info is being set with open permissions: ugo+rw Jul 10 00:48:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5d6470e2-3a2a-4175-a274-849595324834 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:20 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.info Jul 10 00:48:20 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:20 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:48:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Flow 'volume_create_manager' (e3e5d8f9-5bd5-4400-95a6-20a0996d09d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:48:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5294d949-52de-4a96-b64c-afc03f3d893b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5294d949-52de-4a96-b64c-afc03f3d893b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1243666195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1256f5a3-a0d8-47cc-8a08-962ed7de7dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ea29ee052f4b8aac142f6ce2eb3d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:48:21Z,use_quota=True,user_id='9c4f444d003740afbc235bc3741be420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5376c0-c86d-4441-bc2c-c112bff9897d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5376c0-c86d-4441-bc2c-c112bff9897d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1c83dcf-d083-4840-a0a1-d72bccde7b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1c83dcf-d083-4840-a0a1-d72bccde7b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1256f5a3-a0d8-47cc-8a08-962ed7de7dc9', 'volume_name': 'volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec6be77f-fec8-46a7-bd8e-3f2b146cdd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec6be77f-fec8-46a7-bd8e-3f2b146cdd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:20 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3230f4c8-b178-48cc-9f28-0ddf44189d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:20 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Volume 1256f5a3-a0d8-47cc-8a08-962ed7de7dc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9', 'volume_size': 1} Jul 10 00:48:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:21 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5d6470e2-3a2a-4175-a274-849595324834 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.info" returned: 0 in 0.666s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-5d6470e2-3a2a-4175-a274-849595324834 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.357s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.250s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:21 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1243666195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1256f5a3-a0d8-47cc-8a08-962ed7de7dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ea29ee052f4b8aac142f6ce2eb3d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:48:21Z,use_quota=True,user_id='9c4f444d003740afbc235bc3741be420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:48:21 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Creating volume 1256f5a3-a0d8-47cc-8a08-962ed7de7dc9 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:48:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:21 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:48:21 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:48:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:21 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:48:21 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:48:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:21 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9 1073741824 Jul 10 00:48:21 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:21 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-5d6470e2-3a2a-4175-a274-849595324834 tempest-ProjectMemberTests-1755578239 None] Create snapshot completed successfully Jul 10 00:48:21 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9 1073741824" returned: 0 in 0.808s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:22 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-53990bb8-a087-41b7-86e2-5079fc1e43f7 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-eb5e6e49-74d6-4851-98d5-0fb6c62bd422-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:22 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-53990bb8-a087-41b7-86e2-5079fc1e43f7 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-eb5e6e49-74d6-4851-98d5-0fb6c62bd422-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:22 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-53990bb8-a087-41b7-86e2-5079fc1e43f7 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-1388f9e0-e8b6-4506-8e87-6d6faf387e4a" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:22 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-53990bb8-a087-41b7-86e2-5079fc1e43f7 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-1388f9e0-e8b6-4506-8e87-6d6faf387e4a" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:22 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-53990bb8-a087-41b7-86e2-5079fc1e43f7 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-eb5e6e49-74d6-4851-98d5-0fb6c62bd422" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:22 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9 Jul 10 00:48:22 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:22 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-53990bb8-a087-41b7-86e2-5079fc1e43f7 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-eb5e6e49-74d6-4851-98d5-0fb6c62bd422" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:22 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-53990bb8-a087-41b7-86e2-5079fc1e43f7 tempest-ProjectMemberTests-1755578239 None] Deleting offline snapshot eb5e6e49-74d6-4851-98d5-0fb6c62bd422 of volume 1388f9e0-e8b6-4506-8e87-6d6faf387e4a {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:48:22 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-53990bb8-a087-41b7-86e2-5079fc1e43f7 tempest-ProjectMemberTests-1755578239 None] snapshot_file for this snap is: volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.eb5e6e49-74d6-4851-98d5-0fb6c62bd422 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:48:22 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4ed9da-69b9-4d76-b974-beb4315c58d5]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-53990bb8-a087-41b7-86e2-5079fc1e43f7 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.eb5e6e49-74d6-4851-98d5-0fb6c62bd422 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:22 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.eb5e6e49-74d6-4851-98d5-0fb6c62bd422 Jul 10 00:48:22 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:22 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9" returned: 0 in 0.631s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:22 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:48:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3230f4c8-b178-48cc-9f28-0ddf44189d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db40cd5-4f56-42b2-9698-b9343599f6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:22 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Volume volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9 (1256f5a3-a0d8-47cc-8a08-962ed7de7dc9): created successfully Jul 10 00:48:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db40cd5-4f56-42b2-9698-b9343599f6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:22 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Flow 'volume_create_manager' (e3e5d8f9-5bd5-4400-95a6-20a0996d09d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:48:22 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-0c65328b-a9f3-409c-a893-8befd4f454ac tempest-ProjectReaderTests-619335768 None] Created volume successfully. Jul 10 00:48:22 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-53990bb8-a087-41b7-86e2-5079fc1e43f7 tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.eb5e6e49-74d6-4851-98d5-0fb6c62bd422" returned: 0 in 0.736s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:22 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-53990bb8-a087-41b7-86e2-5079fc1e43f7 tempest-ProjectMemberTests-1755578239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:48:22 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[050a6291-dd9b-4442-87a6-2d228fe023bd]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-53990bb8-a087-41b7-86e2-5079fc1e43f7 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:22 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a Jul 10 00:48:22 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c7b6978e-ca23-4736-8d05-ce61c3d87bc0 tempest-ProjectReaderTests-619335768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c7b6978e-ca23-4736-8d05-ce61c3d87bc0 tempest-ProjectReaderTests-619335768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:23 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-c7b6978e-ca23-4736-8d05-ce61c3d87bc0 tempest-ProjectReaderTests-619335768 None] Creating offline snapshot ed1c750c-887d-4759-a209-ed990b9d4c2c of volume 1256f5a3-a0d8-47cc-8a08-962ed7de7dc9 {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:48:23 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[416a4839-9bbf-423f-9f0c-cdb505558927]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c7b6978e-ca23-4736-8d05-ce61c3d87bc0 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:23 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9 Jul 10 00:48:23 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:23 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-53990bb8-a087-41b7-86e2-5079fc1e43f7 tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a" returned: 0 in 0.761s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-53990bb8-a087-41b7-86e2-5079fc1e43f7 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.eb5e6e49-74d6-4851-98d5-0fb6c62bd422 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:23 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.eb5e6e49-74d6-4851-98d5-0fb6c62bd422 Jul 10 00:48:23 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:23 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c7b6978e-ca23-4736-8d05-ce61c3d87bc0 tempest-ProjectReaderTests-619335768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9" returned: 0 in 0.743s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:23 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c7b6978e-ca23-4736-8d05-ce61c3d87bc0 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.ed1c750c-887d-4759-a209-ed990b9d4c2c 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:23 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.ed1c750c-887d-4759-a209-ed990b9d4c2c 1G Jul 10 00:48:23 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:24 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-53990bb8-a087-41b7-86e2-5079fc1e43f7 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.eb5e6e49-74d6-4851-98d5-0fb6c62bd422" returned: 0 in 0.724s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-53990bb8-a087-41b7-86e2-5079fc1e43f7 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.eb5e6e49-74d6-4851-98d5-0fb6c62bd422 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:24 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.eb5e6e49-74d6-4851-98d5-0fb6c62bd422 Jul 10 00:48:24 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:24 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c7b6978e-ca23-4736-8d05-ce61c3d87bc0 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.ed1c750c-887d-4759-a209-ed990b9d4c2c 1G" returned: 0 in 0.804s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:24 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c7b6978e-ca23-4736-8d05-ce61c3d87bc0 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.ed1c750c-887d-4759-a209-ed990b9d4c2c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:24 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.ed1c750c-887d-4759-a209-ed990b9d4c2c Jul 10 00:48:24 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:25 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-53990bb8-a087-41b7-86e2-5079fc1e43f7 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a.eb5e6e49-74d6-4851-98d5-0fb6c62bd422" returned: 0 in 0.659s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:25 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-53990bb8-a087-41b7-86e2-5079fc1e43f7 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-eb5e6e49-74d6-4851-98d5-0fb6c62bd422" released by "_delete_snapshot" :: held 2.980s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:25 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-53990bb8-a087-41b7-86e2-5079fc1e43f7 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-1388f9e0-e8b6-4506-8e87-6d6faf387e4a" released by "delete_snapshot" :: held 3.005s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:25 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-53990bb8-a087-41b7-86e2-5079fc1e43f7 tempest-ProjectMemberTests-1755578239 None] Created reservations ['ef9fccac-bed2-49b0-91b2-4357152fc092', '8c7d67ef-59c6-4b95-9bf3-5d79a97c5679', '132aea45-6307-4f6f-9e10-e97081bda1d3', 'a34663be-6fdb-45d5-8de2-d44db26a532a'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:48:25 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-53990bb8-a087-41b7-86e2-5079fc1e43f7 tempest-ProjectMemberTests-1755578239 None] Delete snapshot completed successfully. Jul 10 00:48:25 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-53990bb8-a087-41b7-86e2-5079fc1e43f7 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-eb5e6e49-74d6-4851-98d5-0fb6c62bd422-delete_snapshot" released by "delete_snapshot" :: held 3.181s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:25 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c7b6978e-ca23-4736-8d05-ce61c3d87bc0 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.ed1c750c-887d-4759-a209-ed990b9d4c2c" returned: 0 in 0.673s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:25 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-c7b6978e-ca23-4736-8d05-ce61c3d87bc0 tempest-ProjectReaderTests-619335768 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.ed1c750c-887d-4759-a209-ed990b9d4c2c is being set with open permissions: ugo+rw Jul 10 00:48:25 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c7b6978e-ca23-4736-8d05-ce61c3d87bc0 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.ed1c750c-887d-4759-a209-ed990b9d4c2c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:25 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.ed1c750c-887d-4759-a209-ed990b9d4c2c Jul 10 00:48:25 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:26 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c7b6978e-ca23-4736-8d05-ce61c3d87bc0 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.ed1c750c-887d-4759-a209-ed990b9d4c2c" returned: 0 in 0.677s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c7b6978e-ca23-4736-8d05-ce61c3d87bc0 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:26 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.info Jul 10 00:48:26 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-97f6cb9d-cc63-4a9a-8853-7335164fb96e tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-1388f9e0-e8b6-4506-8e87-6d6faf387e4a-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-97f6cb9d-cc63-4a9a-8853-7335164fb96e tempest-ProjectMemberTests-1755578239 None] Lock "cinder-1388f9e0-e8b6-4506-8e87-6d6faf387e4a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-97f6cb9d-cc63-4a9a-8853-7335164fb96e tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-1388f9e0-e8b6-4506-8e87-6d6faf387e4a" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:26 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-97f6cb9d-cc63-4a9a-8853-7335164fb96e tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-1388f9e0-e8b6-4506-8e87-6d6faf387e4a" acquired by "delete_volume" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:26 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23e7367-6699-4279-8826-9a40f24de56f]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-97f6cb9d-cc63-4a9a-8853-7335164fb96e tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:26 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a Jul 10 00:48:26 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:26 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c7b6978e-ca23-4736-8d05-ce61c3d87bc0 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.info" returned: 0 in 0.643s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:26 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-c7b6978e-ca23-4736-8d05-ce61c3d87bc0 tempest-ProjectReaderTests-619335768 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.info is being set with open permissions: ugo+rw Jul 10 00:48:26 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c7b6978e-ca23-4736-8d05-ce61c3d87bc0 tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:26 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.info Jul 10 00:48:26 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:27 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-97f6cb9d-cc63-4a9a-8853-7335164fb96e tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a" returned: 0 in 0.716s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-97f6cb9d-cc63-4a9a-8853-7335164fb96e tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:27 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a Jul 10 00:48:27 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:27 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c7b6978e-ca23-4736-8d05-ce61c3d87bc0 tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.info" returned: 0 in 0.632s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c7b6978e-ca23-4736-8d05-ce61c3d87bc0 tempest-ProjectReaderTests-619335768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.260s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:27 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-c7b6978e-ca23-4736-8d05-ce61c3d87bc0 tempest-ProjectReaderTests-619335768 None] Create snapshot completed successfully Jul 10 00:48:27 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-97f6cb9d-cc63-4a9a-8853-7335164fb96e tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1388f9e0-e8b6-4506-8e87-6d6faf387e4a" returned: 0 in 0.636s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:27 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-97f6cb9d-cc63-4a9a-8853-7335164fb96e tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-1388f9e0-e8b6-4506-8e87-6d6faf387e4a" released by "delete_volume" :: held 1.409s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:27 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-97f6cb9d-cc63-4a9a-8853-7335164fb96e tempest-ProjectMemberTests-1755578239 None] Created reservations ['b145cf54-ff46-4246-99f5-ee41af7a663f', 'ecf2e051-ca8a-41db-bec2-932602aafe69', 'ba5e9a6b-b45a-4f91-be3c-bd9b7e9b5732', 'ea57620c-70a4-47ca-a05c-df536c359eb7'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:48:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-97f6cb9d-cc63-4a9a-8853-7335164fb96e tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-97f6cb9d-cc63-4a9a-8853-7335164fb96e tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:27 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-97f6cb9d-cc63-4a9a-8853-7335164fb96e tempest-ProjectMemberTests-1755578239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:48:27 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-97f6cb9d-cc63-4a9a-8853-7335164fb96e tempest-ProjectMemberTests-1755578239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:48:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-97f6cb9d-cc63-4a9a-8853-7335164fb96e tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:27 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-97f6cb9d-cc63-4a9a-8853-7335164fb96e tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:27 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:48:27 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:28 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-4b1c6ec3-cd13-46f6-b6a0-f2c247a79aaf tempest-ProjectReaderTests-619335768 None] Acquiring lock "cinder-ed1c750c-887d-4759-a209-ed990b9d4c2c-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:28 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-4b1c6ec3-cd13-46f6-b6a0-f2c247a79aaf tempest-ProjectReaderTests-619335768 None] Lock "cinder-ed1c750c-887d-4759-a209-ed990b9d4c2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:28 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-4b1c6ec3-cd13-46f6-b6a0-f2c247a79aaf tempest-ProjectReaderTests-619335768 None] Acquiring lock "cinder-quobyte-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:28 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-4b1c6ec3-cd13-46f6-b6a0-f2c247a79aaf tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:28 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-4b1c6ec3-cd13-46f6-b6a0-f2c247a79aaf tempest-ProjectReaderTests-619335768 None] Acquiring lock "cinder-quobyte-ed1c750c-887d-4759-a209-ed990b9d4c2c" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:28 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-4b1c6ec3-cd13-46f6-b6a0-f2c247a79aaf tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-ed1c750c-887d-4759-a209-ed990b9d4c2c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-4b1c6ec3-cd13-46f6-b6a0-f2c247a79aaf tempest-ProjectReaderTests-619335768 None] Deleting offline snapshot ed1c750c-887d-4759-a209-ed990b9d4c2c of volume 1256f5a3-a0d8-47cc-8a08-962ed7de7dc9 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:48:28 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-4b1c6ec3-cd13-46f6-b6a0-f2c247a79aaf tempest-ProjectReaderTests-619335768 None] snapshot_file for this snap is: volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.ed1c750c-887d-4759-a209-ed990b9d4c2c {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:48:28 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3082509-d8ad-4f22-a481-caf474ab3061]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4b1c6ec3-cd13-46f6-b6a0-f2c247a79aaf tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.ed1c750c-887d-4759-a209-ed990b9d4c2c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:28 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:28 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-97f6cb9d-cc63-4a9a-8853-7335164fb96e tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.696s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:28 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-97f6cb9d-cc63-4a9a-8853-7335164fb96e tempest-ProjectMemberTests-1755578239 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:48:28 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-97f6cb9d-cc63-4a9a-8853-7335164fb96e tempest-ProjectMemberTests-1755578239 None] Deleted volume successfully. Jul 10 00:48:28 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.ed1c750c-887d-4759-a209-ed990b9d4c2c Jul 10 00:48:28 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:28 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-97f6cb9d-cc63-4a9a-8853-7335164fb96e tempest-ProjectMemberTests-1755578239 None] Lock "cinder-1388f9e0-e8b6-4506-8e87-6d6faf387e4a-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:28 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:48:28 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Flow 'volume_create_manager' (6d6849f2-e6ec-48f4-9fb9-ae91df98814a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca40dc9-2b84-427f-83ee-4e2381061e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=140,cinder:INSERT=43,cinder:UPDATE=161,cinder:DELETE=16 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca40dc9-2b84-427f-83ee-4e2381061e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1003352027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb602db3-ce5e-4aff-9c49-7da55f292340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f238e094d83c41769907fe7fe98cb92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:48:29Z,use_quota=True,user_id='6ae3ebc77379400a81756522642f35cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f760ed2-a6a3-4057-bc1e-0194cb29ca79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f760ed2-a6a3-4057-bc1e-0194cb29ca79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f32b9aa4-a1d1-4c39-b911-1b8c192103bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f32b9aa4-a1d1-4c39-b911-1b8c192103bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb602db3-ce5e-4aff-9c49-7da55f292340', 'volume_name': 'volume-eb602db3-ce5e-4aff-9c49-7da55f292340', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82265b6d-90ba-4ab0-8850-14a4bdb4fb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82265b6d-90ba-4ab0-8850-14a4bdb4fb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52cc8058-1126-43c5-8dec-ac8aa533697b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:29 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Volume eb602db3-ce5e-4aff-9c49-7da55f292340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb602db3-ce5e-4aff-9c49-7da55f292340', 'volume_size': 1} Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1003352027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb602db3-ce5e-4aff-9c49-7da55f292340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f238e094d83c41769907fe7fe98cb92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:48:29Z,use_quota=True,user_id='6ae3ebc77379400a81756522642f35cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Creating volume eb602db3-ce5e-4aff-9c49-7da55f292340 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:48:29 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:29 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340 1073741824 Jul 10 00:48:29 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:29 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4b1c6ec3-cd13-46f6-b6a0-f2c247a79aaf tempest-ProjectReaderTests-619335768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.ed1c750c-887d-4759-a209-ed990b9d4c2c" returned: 0 in 0.819s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-4b1c6ec3-cd13-46f6-b6a0-f2c247a79aaf tempest-ProjectReaderTests-619335768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2d53c0-ca64-4367-854d-5a6e8a52ce8e]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4b1c6ec3-cd13-46f6-b6a0-f2c247a79aaf tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:29 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9 Jul 10 00:48:29 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:29 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340 1073741824" returned: 0 in 0.878s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:29 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:30 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340 Jul 10 00:48:30 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:30 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4b1c6ec3-cd13-46f6-b6a0-f2c247a79aaf tempest-ProjectReaderTests-619335768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9" returned: 0 in 0.823s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4b1c6ec3-cd13-46f6-b6a0-f2c247a79aaf tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.ed1c750c-887d-4759-a209-ed990b9d4c2c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:30 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.ed1c750c-887d-4759-a209-ed990b9d4c2c Jul 10 00:48:30 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:30 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340" returned: 0 in 0.650s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:30 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:48:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52cc8058-1126-43c5-8dec-ac8aa533697b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb602db3-ce5e-4aff-9c49-7da55f292340', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4100b1d-1702-4648-b3b7-c0aec3d53099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:30 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Volume volume-eb602db3-ce5e-4aff-9c49-7da55f292340 (eb602db3-ce5e-4aff-9c49-7da55f292340): created successfully Jul 10 00:48:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4100b1d-1702-4648-b3b7-c0aec3d53099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:30 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Flow 'volume_create_manager' (6d6849f2-e6ec-48f4-9fb9-ae91df98814a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:48:30 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-4615acb7-0f1b-4711-8be2-86fe428f753f tempest-ProjectMemberTests-1755578239 None] Created volume successfully. Jul 10 00:48:30 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4b1c6ec3-cd13-46f6-b6a0-f2c247a79aaf tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.ed1c750c-887d-4759-a209-ed990b9d4c2c" returned: 0 in 0.718s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:30 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4b1c6ec3-cd13-46f6-b6a0-f2c247a79aaf tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.ed1c750c-887d-4759-a209-ed990b9d4c2c {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:30 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.ed1c750c-887d-4759-a209-ed990b9d4c2c Jul 10 00:48:30 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f6a20e1a-938f-4b0e-bfdf-979e7433175f tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f6a20e1a-938f-4b0e-bfdf-979e7433175f tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-f6a20e1a-938f-4b0e-bfdf-979e7433175f tempest-ProjectMemberTests-1755578239 None] Creating offline snapshot 85dfa9d8-d7c1-4f8f-a931-41fa02f656ed of volume eb602db3-ce5e-4aff-9c49-7da55f292340 {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:48:31 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca933701-bbd1-4caa-80e8-c687cd26e94a]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f6a20e1a-938f-4b0e-bfdf-979e7433175f tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:31 devstack sudo[108283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340 Jul 10 00:48:31 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:31 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-4b1c6ec3-cd13-46f6-b6a0-f2c247a79aaf tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9.ed1c750c-887d-4759-a209-ed990b9d4c2c" returned: 0 in 0.666s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:31 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-4b1c6ec3-cd13-46f6-b6a0-f2c247a79aaf tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-ed1c750c-887d-4759-a209-ed990b9d4c2c" released by "_delete_snapshot" :: held 3.127s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:31 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-4b1c6ec3-cd13-46f6-b6a0-f2c247a79aaf tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9" released by "delete_snapshot" :: held 3.148s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:31 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-4b1c6ec3-cd13-46f6-b6a0-f2c247a79aaf tempest-ProjectReaderTests-619335768 None] Created reservations ['3c56c752-718d-4071-b291-4d57b5525549', 'da4c4fc3-5838-4080-a52b-8cc7a2314ccd', '66bc9a39-1a4e-460b-9de3-a26a04284466', '2e6f0a26-ee5a-4c95-af87-9b52966fcdc5'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:48:31 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-4b1c6ec3-cd13-46f6-b6a0-f2c247a79aaf tempest-ProjectReaderTests-619335768 None] Delete snapshot completed successfully. Jul 10 00:48:31 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-4b1c6ec3-cd13-46f6-b6a0-f2c247a79aaf tempest-ProjectReaderTests-619335768 None] Lock "cinder-ed1c750c-887d-4759-a209-ed990b9d4c2c-delete_snapshot" released by "delete_snapshot" :: held 3.291s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:48:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:48:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:48:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:31 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:48:31 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:31 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f6a20e1a-938f-4b0e-bfdf-979e7433175f tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340" returned: 0 in 0.765s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f6a20e1a-938f-4b0e-bfdf-979e7433175f tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340.85dfa9d8-d7c1-4f8f-a931-41fa02f656ed 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:32 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340.85dfa9d8-d7c1-4f8f-a931-41fa02f656ed 1G Jul 10 00:48:32 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:32 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.624s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:32 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:48:32 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:48:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 29 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:48:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:48:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-440dd3e3-b545-442c-888a-ec969dc567cd tempest-ProjectReaderTests-619335768 None] Acquiring lock "cinder-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-440dd3e3-b545-442c-888a-ec969dc567cd tempest-ProjectReaderTests-619335768 None] Lock "cinder-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-440dd3e3-b545-442c-888a-ec969dc567cd tempest-ProjectReaderTests-619335768 None] Acquiring lock "cinder-quobyte-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:32 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-440dd3e3-b545-442c-888a-ec969dc567cd tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9" acquired by "delete_volume" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:32 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[691889b6-0bc1-4043-aed3-9d125ccb59ad]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-440dd3e3-b545-442c-888a-ec969dc567cd tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:32 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9 Jul 10 00:48:32 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:32 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f6a20e1a-938f-4b0e-bfdf-979e7433175f tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340.85dfa9d8-d7c1-4f8f-a931-41fa02f656ed 1G" returned: 0 in 0.818s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f6a20e1a-938f-4b0e-bfdf-979e7433175f tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb602db3-ce5e-4aff-9c49-7da55f292340 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340.85dfa9d8-d7c1-4f8f-a931-41fa02f656ed {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:32 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb602db3-ce5e-4aff-9c49-7da55f292340 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340.85dfa9d8-d7c1-4f8f-a931-41fa02f656ed Jul 10 00:48:32 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:33 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-440dd3e3-b545-442c-888a-ec969dc567cd tempest-ProjectReaderTests-619335768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9" returned: 0 in 0.746s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-440dd3e3-b545-442c-888a-ec969dc567cd tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:33 devstack sudo[108307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9 Jul 10 00:48:33 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:33 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f6a20e1a-938f-4b0e-bfdf-979e7433175f tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb602db3-ce5e-4aff-9c49-7da55f292340 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340.85dfa9d8-d7c1-4f8f-a931-41fa02f656ed" returned: 0 in 0.693s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:33 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-f6a20e1a-938f-4b0e-bfdf-979e7433175f tempest-ProjectMemberTests-1755578239 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340.85dfa9d8-d7c1-4f8f-a931-41fa02f656ed is being set with open permissions: ugo+rw Jul 10 00:48:33 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f6a20e1a-938f-4b0e-bfdf-979e7433175f tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340.85dfa9d8-d7c1-4f8f-a931-41fa02f656ed {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:33 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340.85dfa9d8-d7c1-4f8f-a931-41fa02f656ed Jul 10 00:48:33 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:34 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-440dd3e3-b545-442c-888a-ec969dc567cd tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9" returned: 0 in 0.640s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:34 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-440dd3e3-b545-442c-888a-ec969dc567cd tempest-ProjectReaderTests-619335768 None] Lock "cinder-quobyte-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9" released by "delete_volume" :: held 1.447s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:34 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-440dd3e3-b545-442c-888a-ec969dc567cd tempest-ProjectReaderTests-619335768 None] Created reservations ['997e5bdd-9fc6-4aca-b1d4-c3a35e6fd9a1', '77c26de2-3550-4ae9-8400-9c1636e2f0b1', '48405bb1-1de9-4b13-b414-92eebe3444f9', 'e957f459-ea48-41f5-848a-70085c7da682'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:48:34 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f6a20e1a-938f-4b0e-bfdf-979e7433175f tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340.85dfa9d8-d7c1-4f8f-a931-41fa02f656ed" returned: 0 in 0.662s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f6a20e1a-938f-4b0e-bfdf-979e7433175f tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-440dd3e3-b545-442c-888a-ec969dc567cd tempest-ProjectReaderTests-619335768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-440dd3e3-b545-442c-888a-ec969dc567cd tempest-ProjectReaderTests-619335768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-440dd3e3-b545-442c-888a-ec969dc567cd tempest-ProjectReaderTests-619335768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:48:34 devstack sudo[108313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340.info Jul 10 00:48:34 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:34 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-440dd3e3-b545-442c-888a-ec969dc567cd tempest-ProjectReaderTests-619335768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:48:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-440dd3e3-b545-442c-888a-ec969dc567cd tempest-ProjectReaderTests-619335768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-440dd3e3-b545-442c-888a-ec969dc567cd tempest-ProjectReaderTests-619335768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:34 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:48:34 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:34 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-440dd3e3-b545-442c-888a-ec969dc567cd tempest-ProjectReaderTests-619335768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.634s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:34 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-440dd3e3-b545-442c-888a-ec969dc567cd tempest-ProjectReaderTests-619335768 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:48:34 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-440dd3e3-b545-442c-888a-ec969dc567cd tempest-ProjectReaderTests-619335768 None] Deleted volume successfully. Jul 10 00:48:34 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-440dd3e3-b545-442c-888a-ec969dc567cd tempest-ProjectReaderTests-619335768 None] Lock "cinder-1256f5a3-a0d8-47cc-8a08-962ed7de7dc9-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:34 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f6a20e1a-938f-4b0e-bfdf-979e7433175f tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340.info" returned: 0 in 0.705s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:34 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-f6a20e1a-938f-4b0e-bfdf-979e7433175f tempest-ProjectMemberTests-1755578239 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340.info is being set with open permissions: ugo+rw Jul 10 00:48:34 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f6a20e1a-938f-4b0e-bfdf-979e7433175f tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:34 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340.info Jul 10 00:48:34 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:35 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-f6a20e1a-938f-4b0e-bfdf-979e7433175f tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340.info" returned: 0 in 0.670s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:35 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-f6a20e1a-938f-4b0e-bfdf-979e7433175f tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.397s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:35 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-f6a20e1a-938f-4b0e-bfdf-979e7433175f tempest-ProjectMemberTests-1755578239 None] Create snapshot completed successfully Jul 10 00:48:36 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8a875ba7-2337-4180-a3e1-b92d74145bc6 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-85dfa9d8-d7c1-4f8f-a931-41fa02f656ed-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:36 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8a875ba7-2337-4180-a3e1-b92d74145bc6 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-85dfa9d8-d7c1-4f8f-a931-41fa02f656ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:36 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8a875ba7-2337-4180-a3e1-b92d74145bc6 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-eb602db3-ce5e-4aff-9c49-7da55f292340" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:36 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8a875ba7-2337-4180-a3e1-b92d74145bc6 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-eb602db3-ce5e-4aff-9c49-7da55f292340" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:36 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8a875ba7-2337-4180-a3e1-b92d74145bc6 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-85dfa9d8-d7c1-4f8f-a931-41fa02f656ed" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:36 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8a875ba7-2337-4180-a3e1-b92d74145bc6 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-85dfa9d8-d7c1-4f8f-a931-41fa02f656ed" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:36 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8a875ba7-2337-4180-a3e1-b92d74145bc6 tempest-ProjectMemberTests-1755578239 None] Deleting offline snapshot 85dfa9d8-d7c1-4f8f-a931-41fa02f656ed of volume eb602db3-ce5e-4aff-9c49-7da55f292340 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:48:36 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8a875ba7-2337-4180-a3e1-b92d74145bc6 tempest-ProjectMemberTests-1755578239 None] snapshot_file for this snap is: volume-eb602db3-ce5e-4aff-9c49-7da55f292340.85dfa9d8-d7c1-4f8f-a931-41fa02f656ed {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:48:36 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca44204-b98e-45ab-84bf-97081063f18d]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:36 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8a875ba7-2337-4180-a3e1-b92d74145bc6 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340.85dfa9d8-d7c1-4f8f-a931-41fa02f656ed {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:36 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340.85dfa9d8-d7c1-4f8f-a931-41fa02f656ed Jul 10 00:48:36 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:37 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8a875ba7-2337-4180-a3e1-b92d74145bc6 tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340.85dfa9d8-d7c1-4f8f-a931-41fa02f656ed" returned: 0 in 0.748s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:37 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-8a875ba7-2337-4180-a3e1-b92d74145bc6 tempest-ProjectMemberTests-1755578239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb602db3-ce5e-4aff-9c49-7da55f292340(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:48:37 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54c671f-1fa3-405e-b729-5e177fc759f4]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:37 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8a875ba7-2337-4180-a3e1-b92d74145bc6 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:37 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340 Jul 10 00:48:37 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:38 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8a875ba7-2337-4180-a3e1-b92d74145bc6 tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340" returned: 0 in 0.787s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8a875ba7-2337-4180-a3e1-b92d74145bc6 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340.85dfa9d8-d7c1-4f8f-a931-41fa02f656ed {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:38 devstack sudo[108336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340.85dfa9d8-d7c1-4f8f-a931-41fa02f656ed Jul 10 00:48:38 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:38 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8a875ba7-2337-4180-a3e1-b92d74145bc6 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340.85dfa9d8-d7c1-4f8f-a931-41fa02f656ed" returned: 0 in 0.746s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:38 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8a875ba7-2337-4180-a3e1-b92d74145bc6 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340.85dfa9d8-d7c1-4f8f-a931-41fa02f656ed {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:38 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340.85dfa9d8-d7c1-4f8f-a931-41fa02f656ed Jul 10 00:48:38 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:39 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:39 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-8a875ba7-2337-4180-a3e1-b92d74145bc6 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340.85dfa9d8-d7c1-4f8f-a931-41fa02f656ed" returned: 0 in 0.635s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:39 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8a875ba7-2337-4180-a3e1-b92d74145bc6 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-85dfa9d8-d7c1-4f8f-a931-41fa02f656ed" released by "_delete_snapshot" :: held 3.029s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:39 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8a875ba7-2337-4180-a3e1-b92d74145bc6 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-eb602db3-ce5e-4aff-9c49-7da55f292340" released by "delete_snapshot" :: held 3.055s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:39 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-8a875ba7-2337-4180-a3e1-b92d74145bc6 tempest-ProjectMemberTests-1755578239 None] Created reservations ['ce596864-9d9e-436a-92cd-f1d7df8c2760', '8d804b64-40b1-4508-9ac2-fea11f26e155', '6ed09c7b-9c7b-4fa9-8134-b174a2a3b3ed', 'f567c9cb-a28a-4106-808c-2ec97beafe84'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:48:39 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-8a875ba7-2337-4180-a3e1-b92d74145bc6 tempest-ProjectMemberTests-1755578239 None] Delete snapshot completed successfully. Jul 10 00:48:39 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-8a875ba7-2337-4180-a3e1-b92d74145bc6 tempest-ProjectMemberTests-1755578239 None] Lock "cinder-85dfa9d8-d7c1-4f8f-a931-41fa02f656ed-delete_snapshot" released by "delete_snapshot" :: held 3.218s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:40 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e9c5a45a-fec2-4b8a-a326-e7a2f54bdfdf tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-eb602db3-ce5e-4aff-9c49-7da55f292340-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:40 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e9c5a45a-fec2-4b8a-a326-e7a2f54bdfdf tempest-ProjectMemberTests-1755578239 None] Lock "cinder-eb602db3-ce5e-4aff-9c49-7da55f292340-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:40 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e9c5a45a-fec2-4b8a-a326-e7a2f54bdfdf tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-eb602db3-ce5e-4aff-9c49-7da55f292340" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:40 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e9c5a45a-fec2-4b8a-a326-e7a2f54bdfdf tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-eb602db3-ce5e-4aff-9c49-7da55f292340" acquired by "delete_volume" :: waited 0.017s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:40 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bbee31-24a2-493a-8b2b-c395e900b062]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:40 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e9c5a45a-fec2-4b8a-a326-e7a2f54bdfdf tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:40 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340 Jul 10 00:48:40 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:41 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e9c5a45a-fec2-4b8a-a326-e7a2f54bdfdf tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340" returned: 0 in 0.725s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:41 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e9c5a45a-fec2-4b8a-a326-e7a2f54bdfdf tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:41 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340 Jul 10 00:48:41 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:42 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e9c5a45a-fec2-4b8a-a326-e7a2f54bdfdf tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb602db3-ce5e-4aff-9c49-7da55f292340" returned: 0 in 0.650s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:42 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e9c5a45a-fec2-4b8a-a326-e7a2f54bdfdf tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-eb602db3-ce5e-4aff-9c49-7da55f292340" released by "delete_volume" :: held 1.431s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:42 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-e9c5a45a-fec2-4b8a-a326-e7a2f54bdfdf tempest-ProjectMemberTests-1755578239 None] Created reservations ['2d9e77c0-060d-417e-946e-e74a24878389', '767a19f1-3e52-4177-82b7-f25482b94a71', '6cb452bd-30a4-4ae2-b9cd-fe5eb1c2149a', 'adaf8847-8ed9-4313-83c3-1e10917a1dff'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:48:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e9c5a45a-fec2-4b8a-a326-e7a2f54bdfdf tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e9c5a45a-fec2-4b8a-a326-e7a2f54bdfdf tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:42 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e9c5a45a-fec2-4b8a-a326-e7a2f54bdfdf tempest-ProjectMemberTests-1755578239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:48:42 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-e9c5a45a-fec2-4b8a-a326-e7a2f54bdfdf tempest-ProjectMemberTests-1755578239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:48:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-e9c5a45a-fec2-4b8a-a326-e7a2f54bdfdf tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:42 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e9c5a45a-fec2-4b8a-a326-e7a2f54bdfdf tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:42 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:48:42 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:43 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-e9c5a45a-fec2-4b8a-a326-e7a2f54bdfdf tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.693s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:43 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-e9c5a45a-fec2-4b8a-a326-e7a2f54bdfdf tempest-ProjectMemberTests-1755578239 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:48:43 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-e9c5a45a-fec2-4b8a-a326-e7a2f54bdfdf tempest-ProjectMemberTests-1755578239 None] Deleted volume successfully. Jul 10 00:48:43 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-e9c5a45a-fec2-4b8a-a326-e7a2f54bdfdf tempest-ProjectMemberTests-1755578239 None] Lock "cinder-eb602db3-ce5e-4aff-9c49-7da55f292340-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:43 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:48:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Flow 'volume_create_manager' (86a2c8c1-71d3-4bdc-b794-89bed75bce7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:48:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb6cec7-c6a5-4e75-b6f3-a87f539a1c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb6cec7-c6a5-4e75-b6f3-a87f539a1c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1232756209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ecd4bc-2dc4-4e1a-b94c-85a92138407f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f238e094d83c41769907fe7fe98cb92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:48:43Z,use_quota=True,user_id='6ae3ebc77379400a81756522642f35cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c189096-f7ea-45e7-9856-9c00e39ad819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c189096-f7ea-45e7-9856-9c00e39ad819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b611ed4d-3818-4a88-9e42-186fec639557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b611ed4d-3818-4a88-9e42-186fec639557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66ecd4bc-2dc4-4e1a-b94c-85a92138407f', 'volume_name': 'volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca799c29-7baf-423e-a485-dce5148d7ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca799c29-7baf-423e-a485-dce5148d7ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:43 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e7978d-38a0-46f4-95fd-f115497fb480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:43 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Volume 66ecd4bc-2dc4-4e1a-b94c-85a92138407f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f', 'volume_size': 1} Jul 10 00:48:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1232756209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ecd4bc-2dc4-4e1a-b94c-85a92138407f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f238e094d83c41769907fe7fe98cb92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:48:43Z,use_quota=True,user_id='6ae3ebc77379400a81756522642f35cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:48:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Creating volume 66ecd4bc-2dc4-4e1a-b94c-85a92138407f {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:48:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:48:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:48:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:43 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:48:43 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:48:43 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:43 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f 1073741824 Jul 10 00:48:43 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:44 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f 1073741824" returned: 0 in 0.902s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:44 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:44 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f Jul 10 00:48:44 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:45 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f" returned: 0 in 0.737s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:48:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e7978d-38a0-46f4-95fd-f115497fb480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28be02a0-e8f4-43d6-bc3b-d9191ac5b0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:45 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Volume volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f (66ecd4bc-2dc4-4e1a-b94c-85a92138407f): created successfully Jul 10 00:48:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28be02a0-e8f4-43d6-bc3b-d9191ac5b0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:45 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Flow 'volume_create_manager' (86a2c8c1-71d3-4bdc-b794-89bed75bce7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:48:45 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-edd88a6b-cd6c-4487-a748-725233899402 tempest-ProjectMemberTests-1755578239 None] Created volume successfully. Jul 10 00:48:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7deed777-ca87-44bd-8808-6ac86a7ba057 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7deed777-ca87-44bd-8808-6ac86a7ba057 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:45 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-7deed777-ca87-44bd-8808-6ac86a7ba057 tempest-ProjectMemberTests-1755578239 None] Creating offline snapshot 5ae3358f-8dbb-46f6-98a7-41abab0351c4 of volume 66ecd4bc-2dc4-4e1a-b94c-85a92138407f {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:48:45 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6bb00e-a00d-443b-8b34-146b5b8ab259]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:45 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7deed777-ca87-44bd-8808-6ac86a7ba057 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:45 devstack sudo[108403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f Jul 10 00:48:45 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:46 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7deed777-ca87-44bd-8808-6ac86a7ba057 tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f" returned: 0 in 0.726s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:46 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7deed777-ca87-44bd-8808-6ac86a7ba057 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.5ae3358f-8dbb-46f6-98a7-41abab0351c4 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:46 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.5ae3358f-8dbb-46f6-98a7-41abab0351c4 1G Jul 10 00:48:46 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:47 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7deed777-ca87-44bd-8808-6ac86a7ba057 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.5ae3358f-8dbb-46f6-98a7-41abab0351c4 1G" returned: 0 in 0.748s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7deed777-ca87-44bd-8808-6ac86a7ba057 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.5ae3358f-8dbb-46f6-98a7-41abab0351c4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:47 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.5ae3358f-8dbb-46f6-98a7-41abab0351c4 Jul 10 00:48:47 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:47 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7deed777-ca87-44bd-8808-6ac86a7ba057 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.5ae3358f-8dbb-46f6-98a7-41abab0351c4" returned: 0 in 0.695s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:47 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-7deed777-ca87-44bd-8808-6ac86a7ba057 tempest-ProjectMemberTests-1755578239 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.5ae3358f-8dbb-46f6-98a7-41abab0351c4 is being set with open permissions: ugo+rw Jul 10 00:48:47 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7deed777-ca87-44bd-8808-6ac86a7ba057 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.5ae3358f-8dbb-46f6-98a7-41abab0351c4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:47 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.5ae3358f-8dbb-46f6-98a7-41abab0351c4 Jul 10 00:48:47 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:48 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7deed777-ca87-44bd-8808-6ac86a7ba057 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.5ae3358f-8dbb-46f6-98a7-41abab0351c4" returned: 0 in 0.633s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:48 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7deed777-ca87-44bd-8808-6ac86a7ba057 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:48 devstack sudo[108422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.info Jul 10 00:48:48 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:49 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7deed777-ca87-44bd-8808-6ac86a7ba057 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.info" returned: 0 in 0.672s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:49 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-7deed777-ca87-44bd-8808-6ac86a7ba057 tempest-ProjectMemberTests-1755578239 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.info is being set with open permissions: ugo+rw Jul 10 00:48:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7deed777-ca87-44bd-8808-6ac86a7ba057 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:49 devstack sudo[108425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.info Jul 10 00:48:49 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:49 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7deed777-ca87-44bd-8808-6ac86a7ba057 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.info" returned: 0 in 0.642s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:49 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7deed777-ca87-44bd-8808-6ac86a7ba057 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.195s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:49 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-7deed777-ca87-44bd-8808-6ac86a7ba057 tempest-ProjectMemberTests-1755578239 None] Create snapshot completed successfully Jul 10 00:48:50 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fdcf1dd3-f4b5-4256-80b3-15f1b076a57d tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-5ae3358f-8dbb-46f6-98a7-41abab0351c4-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:50 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fdcf1dd3-f4b5-4256-80b3-15f1b076a57d tempest-ProjectMemberTests-1755578239 None] Lock "cinder-5ae3358f-8dbb-46f6-98a7-41abab0351c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:50 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fdcf1dd3-f4b5-4256-80b3-15f1b076a57d tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-66ecd4bc-2dc4-4e1a-b94c-85a92138407f" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:50 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fdcf1dd3-f4b5-4256-80b3-15f1b076a57d tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-66ecd4bc-2dc4-4e1a-b94c-85a92138407f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:50 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fdcf1dd3-f4b5-4256-80b3-15f1b076a57d tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-5ae3358f-8dbb-46f6-98a7-41abab0351c4" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:50 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fdcf1dd3-f4b5-4256-80b3-15f1b076a57d tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-5ae3358f-8dbb-46f6-98a7-41abab0351c4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-fdcf1dd3-f4b5-4256-80b3-15f1b076a57d tempest-ProjectMemberTests-1755578239 None] Deleting offline snapshot 5ae3358f-8dbb-46f6-98a7-41abab0351c4 of volume 66ecd4bc-2dc4-4e1a-b94c-85a92138407f {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:48:50 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-fdcf1dd3-f4b5-4256-80b3-15f1b076a57d tempest-ProjectMemberTests-1755578239 None] snapshot_file for this snap is: volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.5ae3358f-8dbb-46f6-98a7-41abab0351c4 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:48:50 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34844c9-df88-46dd-be4a-afc639f44f4f]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:50 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fdcf1dd3-f4b5-4256-80b3-15f1b076a57d tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.5ae3358f-8dbb-46f6-98a7-41abab0351c4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:51 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.5ae3358f-8dbb-46f6-98a7-41abab0351c4 Jul 10 00:48:51 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:51 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fdcf1dd3-f4b5-4256-80b3-15f1b076a57d tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.5ae3358f-8dbb-46f6-98a7-41abab0351c4" returned: 0 in 0.766s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:51 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-fdcf1dd3-f4b5-4256-80b3-15f1b076a57d tempest-ProjectMemberTests-1755578239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:48:51 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b67e56f-64c0-41e7-a3c5-968b34c628ad]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:51 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fdcf1dd3-f4b5-4256-80b3-15f1b076a57d tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:51 devstack sudo[108439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f Jul 10 00:48:51 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:52 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fdcf1dd3-f4b5-4256-80b3-15f1b076a57d tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f" returned: 0 in 0.737s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:52 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fdcf1dd3-f4b5-4256-80b3-15f1b076a57d tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.5ae3358f-8dbb-46f6-98a7-41abab0351c4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:52 devstack sudo[108444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.5ae3358f-8dbb-46f6-98a7-41abab0351c4 Jul 10 00:48:52 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:53 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fdcf1dd3-f4b5-4256-80b3-15f1b076a57d tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.5ae3358f-8dbb-46f6-98a7-41abab0351c4" returned: 0 in 0.712s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fdcf1dd3-f4b5-4256-80b3-15f1b076a57d tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.5ae3358f-8dbb-46f6-98a7-41abab0351c4 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:53 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.5ae3358f-8dbb-46f6-98a7-41abab0351c4 Jul 10 00:48:53 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:53 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:53 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-fdcf1dd3-f4b5-4256-80b3-15f1b076a57d tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f.5ae3358f-8dbb-46f6-98a7-41abab0351c4" returned: 0 in 0.632s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fdcf1dd3-f4b5-4256-80b3-15f1b076a57d tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-5ae3358f-8dbb-46f6-98a7-41abab0351c4" released by "_delete_snapshot" :: held 2.939s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:53 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fdcf1dd3-f4b5-4256-80b3-15f1b076a57d tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-66ecd4bc-2dc4-4e1a-b94c-85a92138407f" released by "delete_snapshot" :: held 2.963s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:53 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-fdcf1dd3-f4b5-4256-80b3-15f1b076a57d tempest-ProjectMemberTests-1755578239 None] Created reservations ['165053d8-d7b9-444b-9ab6-1a43dac44f2c', '38121715-58f2-468d-98d4-6c68a6f31a3d', '3e4cb1b1-9fd5-4d42-b9d1-56c93f20379e', '44184f51-07f1-49b3-94ae-f4fc4d10961f'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:48:54 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-fdcf1dd3-f4b5-4256-80b3-15f1b076a57d tempest-ProjectMemberTests-1755578239 None] Delete snapshot completed successfully. Jul 10 00:48:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-fdcf1dd3-f4b5-4256-80b3-15f1b076a57d tempest-ProjectMemberTests-1755578239 None] Lock "cinder-5ae3358f-8dbb-46f6-98a7-41abab0351c4-delete_snapshot" released by "delete_snapshot" :: held 3.102s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7af5ad3f-8b48-46d7-9245-b1808c1f86ea tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-66ecd4bc-2dc4-4e1a-b94c-85a92138407f-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7af5ad3f-8b48-46d7-9245-b1808c1f86ea tempest-ProjectMemberTests-1755578239 None] Lock "cinder-66ecd4bc-2dc4-4e1a-b94c-85a92138407f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7af5ad3f-8b48-46d7-9245-b1808c1f86ea tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-66ecd4bc-2dc4-4e1a-b94c-85a92138407f" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:48:54 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7af5ad3f-8b48-46d7-9245-b1808c1f86ea tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-66ecd4bc-2dc4-4e1a-b94c-85a92138407f" acquired by "delete_volume" :: waited 0.030s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:48:54 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbf823a-47d8-41ef-a7ad-ac7dea03f546]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7af5ad3f-8b48-46d7-9245-b1808c1f86ea tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:54 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f Jul 10 00:48:54 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:54 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7af5ad3f-8b48-46d7-9245-b1808c1f86ea tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f" returned: 0 in 0.765s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:54 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7af5ad3f-8b48-46d7-9245-b1808c1f86ea tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:55 devstack sudo[108457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f Jul 10 00:48:55 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:55 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7af5ad3f-8b48-46d7-9245-b1808c1f86ea tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-66ecd4bc-2dc4-4e1a-b94c-85a92138407f" returned: 0 in 0.619s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:55 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7af5ad3f-8b48-46d7-9245-b1808c1f86ea tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-66ecd4bc-2dc4-4e1a-b94c-85a92138407f" released by "delete_volume" :: held 1.439s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:55 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-7af5ad3f-8b48-46d7-9245-b1808c1f86ea tempest-ProjectMemberTests-1755578239 None] Created reservations ['da2c26c8-164d-4650-9753-e403884b70f5', 'bbeddc79-4677-40f2-b47e-baa0942ad740', '31f2bf02-fa6e-4826-9107-0410dbc7727d', 'bb7e4c89-ab6e-4ea2-b27e-21c20177b494'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:48:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7af5ad3f-8b48-46d7-9245-b1808c1f86ea tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7af5ad3f-8b48-46d7-9245-b1808c1f86ea tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:55 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7af5ad3f-8b48-46d7-9245-b1808c1f86ea tempest-ProjectMemberTests-1755578239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:48:55 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-7af5ad3f-8b48-46d7-9245-b1808c1f86ea tempest-ProjectMemberTests-1755578239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:48:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7af5ad3f-8b48-46d7-9245-b1808c1f86ea tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:55 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7af5ad3f-8b48-46d7-9245-b1808c1f86ea tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:55 devstack sudo[108461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:48:55 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:56 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7af5ad3f-8b48-46d7-9245-b1808c1f86ea tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.639s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:56 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-7af5ad3f-8b48-46d7-9245-b1808c1f86ea tempest-ProjectMemberTests-1755578239 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:48:56 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-7af5ad3f-8b48-46d7-9245-b1808c1f86ea tempest-ProjectMemberTests-1755578239 None] Deleted volume successfully. Jul 10 00:48:56 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-7af5ad3f-8b48-46d7-9245-b1808c1f86ea tempest-ProjectMemberTests-1755578239 None] Lock "cinder-66ecd4bc-2dc4-4e1a-b94c-85a92138407f-delete_volume" released by "delete_volume" :: held 2.294s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:48:56 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:48:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Flow 'volume_create_manager' (ea3330fb-ebff-4734-8847-612ab19a8d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:48:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929b4275-d225-4577-8b38-e275045f0ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929b4275-d225-4577-8b38-e275045f0ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1296589565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2815bfd4-f29e-4a60-a228-f3184c76c897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f238e094d83c41769907fe7fe98cb92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:48:57Z,use_quota=True,user_id='6ae3ebc77379400a81756522642f35cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a1d6a8a-98f8-4458-bc52-541f2537641b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a1d6a8a-98f8-4458-bc52-541f2537641b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed35715-f06e-4024-ae08-6cfe9c23757b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed35715-f06e-4024-ae08-6cfe9c23757b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2815bfd4-f29e-4a60-a228-f3184c76c897', 'volume_name': 'volume-2815bfd4-f29e-4a60-a228-f3184c76c897', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d871f4-46be-417b-8e19-8d280005854f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d871f4-46be-417b-8e19-8d280005854f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:56 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35859415-e0c4-4320-8d4c-b7cf916d9eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:56 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Volume 2815bfd4-f29e-4a60-a228-f3184c76c897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2815bfd4-f29e-4a60-a228-f3184c76c897', 'volume_size': 1} Jul 10 00:48:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1296589565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2815bfd4-f29e-4a60-a228-f3184c76c897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f238e094d83c41769907fe7fe98cb92c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:48:57Z,use_quota=True,user_id='6ae3ebc77379400a81756522642f35cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:48:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Creating volume 2815bfd4-f29e-4a60-a228-f3184c76c897 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:48:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:48:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:48:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:56 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:48:56 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:48:56 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:56 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897 1073741824 Jul 10 00:48:56 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:57 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897 1073741824" returned: 0 in 0.844s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:57 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:57 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897 Jul 10 00:48:57 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:58 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897" returned: 0 in 0.630s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:58 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:48:58 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:48:58 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35859415-e0c4-4320-8d4c-b7cf916d9eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2815bfd4-f29e-4a60-a228-f3184c76c897', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:58 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693e1700-3faa-4e10-9ad0-63a1c67aa9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:48:58 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Volume volume-2815bfd4-f29e-4a60-a228-f3184c76c897 (2815bfd4-f29e-4a60-a228-f3184c76c897): created successfully Jul 10 00:48:58 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693e1700-3faa-4e10-9ad0-63a1c67aa9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:48:58 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Flow 'volume_create_manager' (ea3330fb-ebff-4734-8847-612ab19a8d57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:48:58 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-85d0d68f-5db8-4247-ae91-c47860747dba tempest-ProjectMemberTests-1755578239 None] Created volume successfully. Jul 10 00:48:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7c4cab52-506b-41b3-9f03-8053755edf63 tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:48:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7c4cab52-506b-41b3-9f03-8053755edf63 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:48:59 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-7c4cab52-506b-41b3-9f03-8053755edf63 tempest-ProjectMemberTests-1755578239 None] Creating offline snapshot eca992a2-c33d-4d1c-9e2c-831e46d260a6 of volume 2815bfd4-f29e-4a60-a228-f3184c76c897 {{(pid=88119) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 00:48:59 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7fc73d-4241-4505-9a44-192a2d083687]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:48:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7c4cab52-506b-41b3-9f03-8053755edf63 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:59 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897 Jul 10 00:48:59 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:48:59 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Jul 10 00:48:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7c4cab52-506b-41b3-9f03-8053755edf63 tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897" returned: 0 in 0.795s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:48:59 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7c4cab52-506b-41b3-9f03-8053755edf63 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897.eca992a2-c33d-4d1c-9e2c-831e46d260a6 1G {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:48:59 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897.eca992a2-c33d-4d1c-9e2c-831e46d260a6 1G Jul 10 00:48:59 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:00 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7c4cab52-506b-41b3-9f03-8053755edf63 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897.eca992a2-c33d-4d1c-9e2c-831e46d260a6 1G" returned: 0 in 0.809s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:00 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7c4cab52-506b-41b3-9f03-8053755edf63 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2815bfd4-f29e-4a60-a228-f3184c76c897 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897.eca992a2-c33d-4d1c-9e2c-831e46d260a6 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:00 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2815bfd4-f29e-4a60-a228-f3184c76c897 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897.eca992a2-c33d-4d1c-9e2c-831e46d260a6 Jul 10 00:49:00 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:01 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7c4cab52-506b-41b3-9f03-8053755edf63 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2815bfd4-f29e-4a60-a228-f3184c76c897 -F qcow2 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897.eca992a2-c33d-4d1c-9e2c-831e46d260a6" returned: 0 in 0.676s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:01 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-7c4cab52-506b-41b3-9f03-8053755edf63 tempest-ProjectMemberTests-1755578239 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897.eca992a2-c33d-4d1c-9e2c-831e46d260a6 is being set with open permissions: ugo+rw Jul 10 00:49:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7c4cab52-506b-41b3-9f03-8053755edf63 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897.eca992a2-c33d-4d1c-9e2c-831e46d260a6 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:01 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897.eca992a2-c33d-4d1c-9e2c-831e46d260a6 Jul 10 00:49:01 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:01 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:01 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7c4cab52-506b-41b3-9f03-8053755edf63 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897.eca992a2-c33d-4d1c-9e2c-831e46d260a6" returned: 0 in 0.632s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7c4cab52-506b-41b3-9f03-8053755edf63 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:02 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897.info Jul 10 00:49:02 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:02 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7c4cab52-506b-41b3-9f03-8053755edf63 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897.info" returned: 0 in 0.645s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:02 devstack cinder-volume[88119]: WARNING cinder.volume.drivers.remotefs [None req-7c4cab52-506b-41b3-9f03-8053755edf63 tempest-ProjectMemberTests-1755578239 None] /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897.info is being set with open permissions: ugo+rw Jul 10 00:49:02 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7c4cab52-506b-41b3-9f03-8053755edf63 tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897.info {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:02 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897.info Jul 10 00:49:02 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:03 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-7c4cab52-506b-41b3-9f03-8053755edf63 tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897.info" returned: 0 in 0.625s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:03 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-7c4cab52-506b-41b3-9f03-8053755edf63 tempest-ProjectMemberTests-1755578239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.268s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:03 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-7c4cab52-506b-41b3-9f03-8053755edf63 tempest-ProjectMemberTests-1755578239 None] Create snapshot completed successfully Jul 10 00:49:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-5febebff-3b00-494b-84c7-b06b0c7872df tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-eca992a2-c33d-4d1c-9e2c-831e46d260a6-delete_snapshot" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:49:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-5febebff-3b00-494b-84c7-b06b0c7872df tempest-ProjectMemberTests-1755578239 None] Lock "cinder-eca992a2-c33d-4d1c-9e2c-831e46d260a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:49:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-5febebff-3b00-494b-84c7-b06b0c7872df tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-2815bfd4-f29e-4a60-a228-f3184c76c897" by "delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:49:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-5febebff-3b00-494b-84c7-b06b0c7872df tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-2815bfd4-f29e-4a60-a228-f3184c76c897" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:49:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-5febebff-3b00-494b-84c7-b06b0c7872df tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-eca992a2-c33d-4d1c-9e2c-831e46d260a6" by "_delete_snapshot" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:49:04 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-5febebff-3b00-494b-84c7-b06b0c7872df tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-eca992a2-c33d-4d1c-9e2c-831e46d260a6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:49:04 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-5febebff-3b00-494b-84c7-b06b0c7872df tempest-ProjectMemberTests-1755578239 None] Deleting offline snapshot eca992a2-c33d-4d1c-9e2c-831e46d260a6 of volume 2815bfd4-f29e-4a60-a228-f3184c76c897 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 00:49:04 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-5febebff-3b00-494b-84c7-b06b0c7872df tempest-ProjectMemberTests-1755578239 None] snapshot_file for this snap is: volume-2815bfd4-f29e-4a60-a228-f3184c76c897.eca992a2-c33d-4d1c-9e2c-831e46d260a6 {{(pid=88119) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 00:49:04 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[de460ac9-82a8-45d8-b54a-7206ecf9c405]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:49:04 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5febebff-3b00-494b-84c7-b06b0c7872df tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897.eca992a2-c33d-4d1c-9e2c-831e46d260a6 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:04 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897.eca992a2-c33d-4d1c-9e2c-831e46d260a6 Jul 10 00:49:04 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:05 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5febebff-3b00-494b-84c7-b06b0c7872df tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897.eca992a2-c33d-4d1c-9e2c-831e46d260a6" returned: 0 in 0.741s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:05 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-5febebff-3b00-494b-84c7-b06b0c7872df tempest-ProjectMemberTests-1755578239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2815bfd4-f29e-4a60-a228-f3184c76c897(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88119) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 00:49:05 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[724c29a7-7f9b-41f1-a3b6-312ae95be551]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:49:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5febebff-3b00-494b-84c7-b06b0c7872df tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:05 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897 Jul 10 00:49:05 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:05 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5febebff-3b00-494b-84c7-b06b0c7872df tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897" returned: 0 in 0.769s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:05 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5febebff-3b00-494b-84c7-b06b0c7872df tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897.eca992a2-c33d-4d1c-9e2c-831e46d260a6 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:05 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897.eca992a2-c33d-4d1c-9e2c-831e46d260a6 Jul 10 00:49:05 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:06 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5febebff-3b00-494b-84c7-b06b0c7872df tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897.eca992a2-c33d-4d1c-9e2c-831e46d260a6" returned: 0 in 0.710s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:06 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5febebff-3b00-494b-84c7-b06b0c7872df tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897.eca992a2-c33d-4d1c-9e2c-831e46d260a6 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:06 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897.eca992a2-c33d-4d1c-9e2c-831e46d260a6 Jul 10 00:49:06 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:07 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-5febebff-3b00-494b-84c7-b06b0c7872df tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897.eca992a2-c33d-4d1c-9e2c-831e46d260a6" returned: 0 in 0.628s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-5febebff-3b00-494b-84c7-b06b0c7872df tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-eca992a2-c33d-4d1c-9e2c-831e46d260a6" released by "_delete_snapshot" :: held 2.938s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:49:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-5febebff-3b00-494b-84c7-b06b0c7872df tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-2815bfd4-f29e-4a60-a228-f3184c76c897" released by "delete_snapshot" :: held 2.964s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:49:07 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-5febebff-3b00-494b-84c7-b06b0c7872df tempest-ProjectMemberTests-1755578239 None] Created reservations ['a1c89206-f2d8-468c-8876-5608e7352135', '47830520-e349-4ad5-b491-0039bab05548', '4a409b42-f452-44fb-8028-b7c64a3dc113', 'f37f45b8-9827-42bf-8db7-8d057729af97'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:49:07 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-5febebff-3b00-494b-84c7-b06b0c7872df tempest-ProjectMemberTests-1755578239 None] Delete snapshot completed successfully. Jul 10 00:49:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-5febebff-3b00-494b-84c7-b06b0c7872df tempest-ProjectMemberTests-1755578239 None] Lock "cinder-eca992a2-c33d-4d1c-9e2c-831e46d260a6-delete_snapshot" released by "delete_snapshot" :: held 3.102s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:49:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-85d29fc4-895e-457d-90e2-52a080140a0d tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-2815bfd4-f29e-4a60-a228-f3184c76c897-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:49:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-85d29fc4-895e-457d-90e2-52a080140a0d tempest-ProjectMemberTests-1755578239 None] Lock "cinder-2815bfd4-f29e-4a60-a228-f3184c76c897-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:49:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-85d29fc4-895e-457d-90e2-52a080140a0d tempest-ProjectMemberTests-1755578239 None] Acquiring lock "cinder-quobyte-2815bfd4-f29e-4a60-a228-f3184c76c897" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:49:07 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-85d29fc4-895e-457d-90e2-52a080140a0d tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-2815bfd4-f29e-4a60-a228-f3184c76c897" acquired by "delete_volume" :: waited 0.012s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:49:07 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[da661d21-75c3-48e1-93ce-f2cbeaf0d61b]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:49:07 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-85d29fc4-895e-457d-90e2-52a080140a0d tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:07 devstack sudo[108517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897 Jul 10 00:49:07 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:08 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-85d29fc4-895e-457d-90e2-52a080140a0d tempest-ProjectMemberTests-1755578239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897" returned: 0 in 0.699s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-85d29fc4-895e-457d-90e2-52a080140a0d tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:08 devstack sudo[108522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897 Jul 10 00:49:08 devstack sudo[108522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:08 devstack sudo[108522]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:08 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-85d29fc4-895e-457d-90e2-52a080140a0d tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-2815bfd4-f29e-4a60-a228-f3184c76c897" returned: 0 in 0.615s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:08 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-85d29fc4-895e-457d-90e2-52a080140a0d tempest-ProjectMemberTests-1755578239 None] Lock "cinder-quobyte-2815bfd4-f29e-4a60-a228-f3184c76c897" released by "delete_volume" :: held 1.371s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:49:09 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-85d29fc4-895e-457d-90e2-52a080140a0d tempest-ProjectMemberTests-1755578239 None] Created reservations ['bf3600ae-3f8a-4416-9053-eaefa4948e63', '381a8cc8-1a4a-409b-ae31-32c22023ac3a', '46c74e5b-42de-47ae-9919-507e1e3e433d', 'd15f24a0-53f9-4a95-aef0-f1d0ea140bf6'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:49:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-85d29fc4-895e-457d-90e2-52a080140a0d tempest-ProjectMemberTests-1755578239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-85d29fc4-895e-457d-90e2-52a080140a0d tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:09 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-85d29fc4-895e-457d-90e2-52a080140a0d tempest-ProjectMemberTests-1755578239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:49:09 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-85d29fc4-895e-457d-90e2-52a080140a0d tempest-ProjectMemberTests-1755578239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:49:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-85d29fc4-895e-457d-90e2-52a080140a0d tempest-ProjectMemberTests-1755578239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-85d29fc4-895e-457d-90e2-52a080140a0d tempest-ProjectMemberTests-1755578239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:09 devstack sudo[108525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:49:09 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:09 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:09 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-85d29fc4-895e-457d-90e2-52a080140a0d tempest-ProjectMemberTests-1755578239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.644s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:09 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-85d29fc4-895e-457d-90e2-52a080140a0d tempest-ProjectMemberTests-1755578239 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:49:09 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-85d29fc4-895e-457d-90e2-52a080140a0d tempest-ProjectMemberTests-1755578239 None] Deleted volume successfully. Jul 10 00:49:09 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-85d29fc4-895e-457d-90e2-52a080140a0d tempest-ProjectMemberTests-1755578239 None] Lock "cinder-2815bfd4-f29e-4a60-a228-f3184c76c897-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:49:13 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:49:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Flow 'volume_create_manager' (675ea4f9-311d-411a-869d-bb13479c10df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:49:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1084db4e-080b-4276-897d-86acdf25ad12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1084db4e-080b-4276-897d-86acdf25ad12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1836978165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4d715b-a73f-445e-b7ba-b31323741842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8c9be65f6941d0948712752aef95dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:49:13Z,use_quota=True,user_id='d13bf491bd9d4f5181793e31568c3491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb30a45-c3a6-42e7-986b-843476c98744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb30a45-c3a6-42e7-986b-843476c98744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb19c0c9-3eba-425a-831a-997588db676e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb19c0c9-3eba-425a-831a-997588db676e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d4d715b-a73f-445e-b7ba-b31323741842', 'volume_name': 'volume-4d4d715b-a73f-445e-b7ba-b31323741842', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bd614cc-d518-444d-b266-f0930967fe40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bd614cc-d518-444d-b266-f0930967fe40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:13 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b0c471-d7ed-47c4-ac7f-ce71e3e10672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:13 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Volume 4d4d715b-a73f-445e-b7ba-b31323741842: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d4d715b-a73f-445e-b7ba-b31323741842', 'volume_size': 1} Jul 10 00:49:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1836978165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4d715b-a73f-445e-b7ba-b31323741842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8c9be65f6941d0948712752aef95dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:49:13Z,use_quota=True,user_id='d13bf491bd9d4f5181793e31568c3491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:49:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Creating volume 4d4d715b-a73f-445e-b7ba-b31323741842 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:49:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:49:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:49:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:13 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:49:13 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:49:13 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4d4d715b-a73f-445e-b7ba-b31323741842 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:13 devstack sudo[108528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4d4d715b-a73f-445e-b7ba-b31323741842 1073741824 Jul 10 00:49:13 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:14 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4d4d715b-a73f-445e-b7ba-b31323741842 1073741824" returned: 0 in 0.821s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4d4d715b-a73f-445e-b7ba-b31323741842 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:14 devstack sudo[108534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4d4d715b-a73f-445e-b7ba-b31323741842 Jul 10 00:49:14 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:14 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4d4d715b-a73f-445e-b7ba-b31323741842" returned: 0 in 0.635s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:14 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:49:14 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b0c471-d7ed-47c4-ac7f-ce71e3e10672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d4d715b-a73f-445e-b7ba-b31323741842', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ba4469-1a1b-48d6-b4f0-92de7b11b38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:14 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Volume volume-4d4d715b-a73f-445e-b7ba-b31323741842 (4d4d715b-a73f-445e-b7ba-b31323741842): created successfully Jul 10 00:49:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ba4469-1a1b-48d6-b4f0-92de7b11b38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:14 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Flow 'volume_create_manager' (675ea4f9-311d-411a-869d-bb13479c10df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:49:14 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-dfdba2a2-9f10-41c9-a0b1-5067165f57ec tempest-ProjectReaderTests-647288650 None] Created volume successfully. Jul 10 00:49:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c9f0fa1b-d38b-4925-8735-a0b3b1144ed9 tempest-ProjectReaderTests-647288650 None] Acquiring lock "cinder-4d4d715b-a73f-445e-b7ba-b31323741842-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:49:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c9f0fa1b-d38b-4925-8735-a0b3b1144ed9 tempest-ProjectReaderTests-647288650 None] Lock "cinder-4d4d715b-a73f-445e-b7ba-b31323741842-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:49:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c9f0fa1b-d38b-4925-8735-a0b3b1144ed9 tempest-ProjectReaderTests-647288650 None] Acquiring lock "cinder-quobyte-4d4d715b-a73f-445e-b7ba-b31323741842" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:49:15 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c9f0fa1b-d38b-4925-8735-a0b3b1144ed9 tempest-ProjectReaderTests-647288650 None] Lock "cinder-quobyte-4d4d715b-a73f-445e-b7ba-b31323741842" acquired by "delete_volume" :: waited 0.022s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:49:15 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[6038d9a3-7b50-4a65-943b-3aea3a23471f]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:49:15 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c9f0fa1b-d38b-4925-8735-a0b3b1144ed9 tempest-ProjectReaderTests-647288650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4d4d715b-a73f-445e-b7ba-b31323741842 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:15 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4d4d715b-a73f-445e-b7ba-b31323741842 Jul 10 00:49:15 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:16 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c9f0fa1b-d38b-4925-8735-a0b3b1144ed9 tempest-ProjectReaderTests-647288650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4d4d715b-a73f-445e-b7ba-b31323741842" returned: 0 in 0.789s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c9f0fa1b-d38b-4925-8735-a0b3b1144ed9 tempest-ProjectReaderTests-647288650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4d4d715b-a73f-445e-b7ba-b31323741842 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:16 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4d4d715b-a73f-445e-b7ba-b31323741842 Jul 10 00:49:16 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:16 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:16 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c9f0fa1b-d38b-4925-8735-a0b3b1144ed9 tempest-ProjectReaderTests-647288650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-4d4d715b-a73f-445e-b7ba-b31323741842" returned: 0 in 0.652s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:16 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c9f0fa1b-d38b-4925-8735-a0b3b1144ed9 tempest-ProjectReaderTests-647288650 None] Lock "cinder-quobyte-4d4d715b-a73f-445e-b7ba-b31323741842" released by "delete_volume" :: held 1.480s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:49:17 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-c9f0fa1b-d38b-4925-8735-a0b3b1144ed9 tempest-ProjectReaderTests-647288650 None] Created reservations ['1500b965-4ad6-4ada-8851-cbbee53b2cc7', 'cae11d30-bcf3-4106-8e94-3568ef8840ab', '150ebc8d-b571-4afe-b14c-9271edb69be9', '967ba53e-9c1d-4ff6-88c8-8d5a2d04fa1a'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:49:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c9f0fa1b-d38b-4925-8735-a0b3b1144ed9 tempest-ProjectReaderTests-647288650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c9f0fa1b-d38b-4925-8735-a0b3b1144ed9 tempest-ProjectReaderTests-647288650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0fa1b-d38b-4925-8735-a0b3b1144ed9 tempest-ProjectReaderTests-647288650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:49:17 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-c9f0fa1b-d38b-4925-8735-a0b3b1144ed9 tempest-ProjectReaderTests-647288650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:49:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-c9f0fa1b-d38b-4925-8735-a0b3b1144ed9 tempest-ProjectReaderTests-647288650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c9f0fa1b-d38b-4925-8735-a0b3b1144ed9 tempest-ProjectReaderTests-647288650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:17 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:49:17 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:17 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:17 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-c9f0fa1b-d38b-4925-8735-a0b3b1144ed9 tempest-ProjectReaderTests-647288650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.642s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:17 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-c9f0fa1b-d38b-4925-8735-a0b3b1144ed9 tempest-ProjectReaderTests-647288650 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:49:17 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-c9f0fa1b-d38b-4925-8735-a0b3b1144ed9 tempest-ProjectReaderTests-647288650 None] Deleted volume successfully. Jul 10 00:49:17 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-c9f0fa1b-d38b-4925-8735-a0b3b1144ed9 tempest-ProjectReaderTests-647288650 None] Lock "cinder-4d4d715b-a73f-445e-b7ba-b31323741842-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:49:18 devstack cinder-volume[88119]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88119) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 00:49:18 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Flow 'volume_create_manager' (0d3c1db4-647c-47f2-a451-8a66afcaeede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:49:18 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b11cb89-31c1-49c1-b4c2-48ecc0b1f8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:18 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b11cb89-31c1-49c1-b4c2-48ecc0b1f8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-993494499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb609dc1-49a1-405a-9069-24e72de58123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8c9be65f6941d0948712752aef95dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:49:18Z,use_quota=True,user_id='d13bf491bd9d4f5181793e31568c3491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:18 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2f93ec-d1d6-4aa3-a378-6c843fb637b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:18 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e2f93ec-d1d6-4aa3-a378-6c843fb637b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:18 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34493d02-d896-4856-9f8f-aac095d80a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:18 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34493d02-d896-4856-9f8f-aac095d80a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb609dc1-49a1-405a-9069-24e72de58123', 'volume_name': 'volume-eb609dc1-49a1-405a-9069-24e72de58123', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:18 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e00e9c-53bf-4e9a-9e3e-8d0840907e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:18 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e00e9c-53bf-4e9a-9e3e-8d0840907e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:18 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dac36f2-627d-4ea6-afc3-d27a73a4e9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:18 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Volume eb609dc1-49a1-405a-9069-24e72de58123: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb609dc1-49a1-405a-9069-24e72de58123', 'volume_size': 1} Jul 10 00:49:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:18 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T22:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-993494499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb609dc1-49a1-405a-9069-24e72de58123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8c9be65f6941d0948712752aef95dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T22:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T22:49:18Z,use_quota=True,user_id='d13bf491bd9d4f5181793e31568c3491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(492889f2-c7c1-466c-b4ba-697f49f3c9a7),volume_type_id=492889f2-c7c1-466c-b4ba-697f49f3c9a7)}" {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 00:49:18 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.remotefs [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Creating volume eb609dc1-49a1-405a-9069-24e72de58123 {{(pid=88119) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 00:49:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:18 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:49:18 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:49:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:18 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Selected osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff as target Quobyte volume. {{(pid=88119) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 00:49:18 devstack cinder-volume[88119]: INFO cinder.volume.drivers.remotefs [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] casted to osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff Jul 10 00:49:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb609dc1-49a1-405a-9069-24e72de58123 1073741824 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:18 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb609dc1-49a1-405a-9069-24e72de58123 1073741824 Jul 10 00:49:18 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:18 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:18 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb609dc1-49a1-405a-9069-24e72de58123 1073741824" returned: 0 in 0.810s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb609dc1-49a1-405a-9069-24e72de58123 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:19 devstack sudo[108554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb609dc1-49a1-405a-9069-24e72de58123 Jul 10 00:49:19 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:19 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb609dc1-49a1-405a-9069-24e72de58123" returned: 0 in 0.634s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:19 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'} {{(pid=88119) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 00:49:19 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dac36f2-627d-4ea6-afc3-d27a73a4e9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb609dc1-49a1-405a-9069-24e72de58123', 'volume_size': 1}' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15556e2-be8d-4592-9cb9-4c8fc768b675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 00:49:19 devstack cinder-volume[88119]: INFO cinder.volume.flows.manager.create_volume [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Volume volume-eb609dc1-49a1-405a-9069-24e72de58123 (eb609dc1-49a1-405a-9069-24e72de58123): created successfully Jul 10 00:49:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15556e2-be8d-4592-9cb9-4c8fc768b675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88119) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 00:49:19 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Flow 'volume_create_manager' (0d3c1db4-647c-47f2-a451-8a66afcaeede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88119) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 00:49:19 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-2a59b9b9-db3f-44ba-a28a-e55ff26073c6 tempest-ProjectReaderTests-647288650 None] Created volume successfully. Jul 10 00:49:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a60b29fc-31e0-411f-876d-480246cb0320 tempest-ProjectReaderTests-647288650 None] Acquiring lock "cinder-eb609dc1-49a1-405a-9069-24e72de58123-delete_volume" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:49:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a60b29fc-31e0-411f-876d-480246cb0320 tempest-ProjectReaderTests-647288650 None] Lock "cinder-eb609dc1-49a1-405a-9069-24e72de58123-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:49:20 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=71,cinder:UPDATE=102,cinder:DELETE=10,cinder:INSERT=26 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:49:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a60b29fc-31e0-411f-876d-480246cb0320 tempest-ProjectReaderTests-647288650 None] Acquiring lock "cinder-quobyte-eb609dc1-49a1-405a-9069-24e72de58123" by "delete_volume" {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 00:49:20 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a60b29fc-31e0-411f-876d-480246cb0320 tempest-ProjectReaderTests-647288650 None] Lock "cinder-quobyte-eb609dc1-49a1-405a-9069-24e72de58123" acquired by "delete_volume" :: waited 0.016s {{(pid=88119) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 00:49:20 devstack cinder-volume[88119]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa3fdb7-d17b-4849-bb1d-00543c9efad4]: (4, 'qcow2') {{(pid=89253) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 00:49:20 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a60b29fc-31e0-411f-876d-480246cb0320 tempest-ProjectReaderTests-647288650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb609dc1-49a1-405a-9069-24e72de58123 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:20 devstack sudo[108557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb609dc1-49a1-405a-9069-24e72de58123 Jul 10 00:49:20 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:21 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a60b29fc-31e0-411f-876d-480246cb0320 tempest-ProjectReaderTests-647288650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb609dc1-49a1-405a-9069-24e72de58123" returned: 0 in 0.728s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a60b29fc-31e0-411f-876d-480246cb0320 tempest-ProjectReaderTests-647288650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb609dc1-49a1-405a-9069-24e72de58123 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:21 devstack sudo[108562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb609dc1-49a1-405a-9069-24e72de58123 Jul 10 00:49:21 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:21 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a60b29fc-31e0-411f-876d-480246cb0320 tempest-ProjectReaderTests-647288650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996/volume-eb609dc1-49a1-405a-9069-24e72de58123" returned: 0 in 0.637s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:21 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a60b29fc-31e0-411f-876d-480246cb0320 tempest-ProjectReaderTests-647288650 None] Lock "cinder-quobyte-eb609dc1-49a1-405a-9069-24e72de58123" released by "delete_volume" :: held 1.403s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:49:21 devstack cinder-volume[88119]: DEBUG cinder.quota [None req-a60b29fc-31e0-411f-876d-480246cb0320 tempest-ProjectReaderTests-647288650 None] Created reservations ['bdea4a57-7fac-430f-8658-8d771b08a6b7', '20ad7bc9-c648-4307-971b-806030be27e7', '098d1845-1332-4180-a80c-a818f08e03da', '974790d3-18b7-4d76-8d4e-46683f789436'] {{(pid=88119) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 00:49:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a60b29fc-31e0-411f-876d-480246cb0320 tempest-ProjectReaderTests-647288650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a60b29fc-31e0-411f-876d-480246cb0320 tempest-ProjectReaderTests-647288650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:21 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a60b29fc-31e0-411f-876d-480246cb0320 tempest-ProjectReaderTests-647288650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:49:21 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-a60b29fc-31e0-411f-876d-480246cb0320 tempest-ProjectReaderTests-647288650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:49:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-a60b29fc-31e0-411f-876d-480246cb0320 tempest-ProjectReaderTests-647288650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:21 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a60b29fc-31e0-411f-876d-480246cb0320 tempest-ProjectReaderTests-647288650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:21 devstack sudo[108565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:49:21 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:22 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:22 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-a60b29fc-31e0-411f-876d-480246cb0320 tempest-ProjectReaderTests-647288650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.666s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:22 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-a60b29fc-31e0-411f-876d-480246cb0320 tempest-ProjectReaderTests-647288650 None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:49:22 devstack cinder-volume[88119]: INFO cinder.volume.manager [None req-a60b29fc-31e0-411f-876d-480246cb0320 tempest-ProjectReaderTests-647288650 None] Deleted volume successfully. Jul 10 00:49:22 devstack cinder-volume[88119]: DEBUG cinder.coordination [None req-a60b29fc-31e0-411f-876d-480246cb0320 tempest-ProjectReaderTests-647288650 None] Lock "cinder-eb609dc1-49a1-405a-9069-24e72de58123-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=88119) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 00:49:31 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:49:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 00:49:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 00:49:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff': None} {{(pid=88119) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 00:49:31 devstack cinder-volume[88119]: DEBUG cinder.volume.drivers.quobyte [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2bd2d80e-0a7f-4628-b5ad-74f0fe219cff'] {{(pid=88119) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 00:49:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.lockutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88119) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 00:49:31 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 00:49:31 devstack sudo[108570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996 Jul 10 00:49:31 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 00:49:31 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 00:49:32 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root Jul 10 00:49:32 devstack cinder-volume[88119]: DEBUG oslo_concurrency.processutils [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1136ab8aa4a9d68708bac5506fb93996" returned: 0 in 0.669s {{(pid=88119) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 00:49:32 devstack cinder-volume[88119]: DEBUG cinder.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Notifying Schedulers of capabilities ... {{(pid=88119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 00:49:32 devstack cinder-volume[88119]: DEBUG oslo_service.periodic_task [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] Running periodic task VolumeManager._thread_info {{(pid=88119) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 00:49:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread count: 29 {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 00:49:32 devstack cinder-volume[88119]: DEBUG cinder.volume.manager [None req-44ad911b-6e51-43e0-89cb-cb5ec1c5bc6d None None] thread info: [<_MainThread(MainThread, started 132401719382144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88119) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5474}} Jul 10 00:49:32 devstack cinder-volume[88119]: DEBUG dbcounter [-] [88119] Writing DB stats cinder:SELECT=68,cinder:UPDATE=91,cinder:INSERT=22,cinder:DELETE=6 {{(pid=88119) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}